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“man will become”: Chekhov (1977) 27, quoted in Pinker (2002). Chekhov, A. (1977). Portable Chekhov. 
New York: Penguin. Pinker, S. (2002). The Blank Slate: The Modern Denial of Human Nature. New York: 
Viking. 


awash in misinformation: The most notorious false claim is that Obamacare establishes "death panels" that 
decide who gets to live and die (FactCheck.org, August 14, 2009). Democrats have made some false claims, 
too; for example, about details concerning whether people can keep their health insurance plans under 
Obamacare (FactCheck.org, August 18, 2009). 

exchange with Texas congressman Ron Paul: Politisite (September 13, 2011). 

enormous bets on housing prices: Financial Crisis Inquiry Commission (2011). 

government bailed out several of the investment banks: This move had bipartisan support but was favored 
more strongly by Democrats (US House of Representatives, 2008; US Senate, 2008). 

tippy top . . . 400 percent: Krugman (November 24, 2011). 

“Occupy a Desk!”: Kim (December 12, 2011). 

“class warfare": http://www.huffingtonpost.com/2011/10/06/herman-cain-occupy-wall-street n 998092 
„html. 

the “47 percent”: http://www.motherjones.com/politics/2012/09/watch-full-secret-video-private-romney 
-fundraiser. 

thanks to lower tax rates: Buffett (August 14, 2011). 

“steal and rob people with a gun”: ABC News (December 5, 2011). 

“a parasite who hates her host”: The Rush Limbaugh Show (September 22, 2011). 

values may color our view of the facts: Kahan, Wittlin, etal. (2011); Kahan, Hoffman, et al. (2012); Kahan, 
Jenkins-Smith, et al. (2012); Kahan, Peters, et al. (2012). 

“proper nouns”: Strictly speaking, these are the referents of proper nouns. 

better at getting along: Pinker (2011). 

modern market economies ... of human kindness: Henrich, Boyd, et al. (2001); Henrich, Ensminger, 
etal. (2010); Herrmann et al. (2008). 

twentieth century . . . approximately 230 million people: Leitenberg (2003). 

conflict in Darfur... 300,000 people: Degomme and Guha-Sapir (2010). 

A billion people...live in extreme poverty: World Bank (February 29, 2012) reporting data from 
2008. 

More than twenty million people are forced into labor: International Labour Organization (2012). 

more calls from employers: Bertrand and Mullainathan (2003). 

What are we doing right?: Pinker (2011). 

utilitarianism: John Stuart Mill's utilitarianism and Charles Darwin's theory of natural selection emerged 
around the same time and have had highly overlapping fan bases from the start, beginning with Darwin's and 
Mill's mutual admiration. This is not an accident, I think. Both groundbreaking ideas favor manual mode 
over automatic settings. For a nice discussion, see Wright (1994), chapter 16. 
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“The Tragedy of the Commons”: Hardin (1968). 

central problem of social existence: Von Neumann and Morgenstern (1944); Wright (2000); Nowak (2006). 
This principle has guided the evolution: Margulis (1970); Wilson (2003); Nowak and Sigmund (2005). 
thelarger party will kill: Mitani, Watts, et al. (2010). 

a phenomenon known as cancer: Michor, Iwasa, et al. (2004). 

Darwin himself was absorbed: Darwin (1871/1981). 

“red in tooth and claw”: A. L. Tennyson, In Memoriam AHH, in Tennyson and Edey (1938). 

“M oralit y is a set”: This view originated with Darwin (1871/1981) and has become the consensus view among 
behavioral scientists in recent decades. See Axelrod and Hamilton (1981); Frank (1988); Wright (1994); Sober 
and Wilson (1999); Wilson (2003); Gintis et al. (2005); Joyce (2006); de Waal (2009); Haidt (2012). 

not assuming .. . group selection: Even if morality evolved simply through individual selection, favoring 
capacities for reciprocal altruism, the same argument applies. 

Wittgenstein's famous metaphor: Wittgenstein (1922/1971). 

nature's “intentions”: Birth control might be used to enhance one's long-term genetic prospects through 
judicious family planning, but it certainly doesn't have to be used that way. 
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Prisoner's Dilemma: Puzzles of the Prisoner's Dilemma form were devised by M. Flood and M. Dresher of 
the Rand Corporation. See Poundstone (1992). 

“Golden Rule” .. . every major religion: Blackburn (2001), 101. 

kin selection: Fisher (1930); Haldane (1932); Hamilton (1964); Smith (1964). This mainstay of evolutionary 
biology has once again become controversial. See Nowak, Tarnita, et al. (2010). 

reciprocity, or reciprocal altruism: See Trivers (1971) and Axelrod and Hamilton (1981). Encounters be- 
tween potential cooperators may be chosen or forced. See Rand, A rbesman, et al. (2011). Here, as in the above 
Art and Bud story, ve made their encounters chosen, to be consistent with the Prisoners Dilemma story, but 
in standard models of reciprocal altruism, the encounters are forced by circumstances. In either case, the same 
reciprocal logic applies. 

variations on the Tit for Tat theme: See, for example, Nowak and Sigmund (1993). 

anger, disgust, or contempt: See Rozin, Lowery, et al. (1999) and Chapman, Kim, et al. (2009). Note that 
negative feelings such asanger and disgust are not perfectly interchangeable. Anger is an "approach" emotion, 
motivating active aggression. Disgust, in contrast, isa "withdrawal" emotion that originally evolved to expel 
contaminating substances, such as feces and rotten meat, from the body. Which of these negative attitudes is 
most strategically appropriate will depend on the relative costs and benefits of active aggression versus selec- 
tive disengagement. 

gratitude .. . willingness to cooperate: Rand, Dreber, et al. (2009). 

food-sharing behavior in chimpanzees: De Waal (1989). See also Packer (1977) and Seyfarth and Cheney 
(1984). 

emotional dispositions that we inherited: Gintis, Bowles, et al. (2005). 

things don't always go as planned: Nowak and Sigmund (1992); Rand, Ohtsuki, et al. (2009); Fudenberg, 
Rand, et al. (2010). 

De Waal and Roosmalen: De Waal and Roosmalen (1979). 

program might be called friendship: Scyfarth and Cheney (2012). 

world of our ancestors . . . more violent: Daly and Wilson (1988); Pinker (2011). 

“long pig": Stevenson (1891/2009). 

birth of modern military training: Grossman (1995). 

laboratory study .. . human aversion to violence: Cushman, Gray, et al. (2012). 

Figure 2.2: Adapted with permission from Cushman, Gray, et al. (2012). 

“lost” letters: Milgram, Mann, et al. (1965). 

tips at restaurants: Pinker (2002), 259. 

some researchers have questioned: Cialdini et al. (1987). 

we feel bad for them: Batson et al. (1981); Batson (1991). 

more likely to cooperate . . . in a prisoner's dilemma: Batson and Moran (1999). 

one experiences the feelings of others: In some cases, empathizing does not entail having the same feeling 
as the person with whom one is empathizing. For example, when one empathizes with a child who is scared, 
one need not be scared oneself. 
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neural circuits that are engaged: Singer, Seymour, et al. (2004). Empathy for pain involves the affective 
but not sensory components of pain. Science 303(5661), 1157-1162. 

Oxytocin .. . in maternal care: Pedersen, A scher, et al. (1982). 

Genes... oxytocin: Rodrigues, Saslow, et al. (2009). 

more likely to initiate cooperation: Kosfeld, Heinrichs, et al. (2005). But see Singer, Snozzi, et al. (2008). 
capacity to care about others: De Waal (1997, 2009); Keltner (2009). 

Lady gina-Kohts: As described by de Waal (2009). 

Arnhem Zoo: de Waal (2009). 

without expectation of a reward: Warneken et al. (2006, 2007, 2009). 

capuchin monkeys: Lakshminarayanan and Santos (2008). 

empathy in rats: Bartal, Decety, et al. (2011). 

MAD: The formal theory behind MAD comes from von Neumann and Morgenstern (1944). 

emotional machinery that performs the same function: Frank (1988). See also Schelling (1968). My 
example here follows Pinker (1997), who compares angry passions to the "Doomsday Device" in Stanley 
Kubrick's film Dr. Strangelove. The device is designed to automatically launch a nuclear counterstrike in 
the event of a first strike. 

not the only ones with a taste for vengeance: Jensen, Call, et al. (2007). 

chimps do much the same in the wild: De Waal and Luttrel (1988). 

breaking a promise: Baumgartner, Fischbacher, et al. (2009). 

familial love and friendship . . . irrational: Pinker (2008). 

in-house bank-robbing expert: As in the case of Frank Abagnale. See Abagnale and Redding (2000). 

As Steven Pinker observes: Pinker (2008). 

sometimes regard their leaders: Henrich and Gil-White (2001). 

things larger than ourselves: Keltner and Haidt (2003); Haidt (2012). 

Reputations can also enhance cooperation: Nowak and Sigmund (1998). 

Kevin Haley and Daniel Fessler: Haley and Fessler (2005). 

"Dictator Game": Forsythe, Horowitz, et al. (1994). 

Figure 2.3: Reprinted with permission from Haley and Fessler (2005). 

“honor box” for buying drinks: Bateson, Nettle, et al. (2006). 

65 percent of their conversation time: Dunbar (2004); Dunbar, Marriott, et al. (1997). 

gossiping . . . for social control: Feinberg et al. (2012b); Nowak and Sigmund (1998, 2005); Milinski, 
Sem mann, et al. (2002). 

transgressor appears to be embarrassed: Semin and Manstead (1982); Keltner (2009). 

we're judgmental as babies: Hamlin, Wynn, etal. (2007, 2011). Seealso Sloane, Baillargeon, etal. (2012). 
Figure 2.4: Reprinted with permission from Hamlin, Wynn, et al. (2007). 

the hindering square: In some versions of the experiment, the colors and shapes were reversed, showing 
that it's not justa preference for certain shapes or colors. In another version of the experiment, they showed 
that the infants prefer the helper to a neutral shape and prefer a neutral shape to a hinderer. 
enthnocentrism as universal: Brown (1991). 

parochial altruism: Bernhard, Fischbacher, et al. (2006); Choi and Bowles (2007). 

infants ... language to distinguish: Kinzler, Dupoux, etal. (2007). See also Mahajan and Wynn (2012). 
separating Us from Them: McElreath, Boyd, and Richerson (2003). 

Implicit Association Test: Greenwald, McGhee, et al. (1998); Greenwald and Banaji (1995). 

Try it yourself: https://implicit.harvard.edu/implicit. 

whites have an implicit preference for whites: Greenwald, McGhee, et al. (1998). 

children ... same kind of race-based biases: Baron and Banaji (2006). 

IAT developed for monkeys: Mahajan, Martinez, et al. (2011). 

(Emily, Greg)... (Lakisha, Jamal): Bertrand and Mullainathan (2003). 

stereotypically black facial features: Eberhardt, Davies, et al. (2006). 

Google searches: Stephens- Davidowitz (2012). 

sensitivity to race... group membership: Kurzban, Tooby, et al. (2001). 

Classic studies by Henri Tajfel: Tajfel (1970, 1982); Tajfel and Turner (1979). 

oxytocin... out-group members: De Dreu, Greer, et al. (2010, 2011). 

"nasty, brutish, and short": Hobbes (1651/1994). 

religion may be a device: Wilson (2003); Roes and Raymond (2003); Norenzayan and Shariff 
(2008). 

wary of people who are not *God-fearing": Gervais, Shariff, et al. (2011). 

enforced cooperation: Boyd and Richerson (1992). 

pre-agricultural societies are rather egalitarian: Boehm (2001). 
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odds of getting punished .. . very high: This assumes that the punished cannot or will not retaliate in full 
force against the punishers. If they can and do, cooperation may break down. See Dreber, Rand, et al. (2008); 
Hermann, Thóni, et al. (2008). 

indirect reciprocity: Gintis (2000); Bowles, Gintis. et al. (2003); Gintis, Bowles, et al. (2005). 

"altruistic punishment": Fehr and Gichter (2002); Boyd, Gintis, et al. (2003). 

people are... pro-social punishers: Fehr and Gáchter (2002); Marlowe, Berbesque, et al. (2008). But see 
Kurzban, DeScioli, et al. (2007). 

"Public Goods Game": Dawes, McTavish, et al. (1977). 

contributions typically go up: Boyd and Richerson (1992); Fehr and Gáchter (1999). 

pro-social punishment is just a by-product: Kurzban, DeScioli, et al. (2007). 

pro-social punishment evolved through: Boyd, Gintis, et al. (2003). 

life on Earth .. . story of increasingly complex cooperation: Margulis (1970); Nowak (2006); Wright 
(2000). 

familiar features of human nature: Many of them appear on Donald Brown's (1991) list of human univer- 
sals (e.g., “empathy,” “gossip,” "shame," "revenge"), and all of them are closely related to, if not logically en- 
tailed by, items on his list. 

feelings that do this thinking for us . .. series of studies: Rand, Greene, et al. (2012). 

Figure 2.5: All data reported in ibid. Decision time (in log10 seconds) is on the x-axes. Contribution level is 
on the y-axes, expressed as a percentage of the maximum (top) or probability of cooperation given a yes/no 
choice (all others). Top: A one-shot Public Goods Game. M iddle left: First decision from a series of one-shot 
Prisoner's Dilemmas. Middle right: A repeated Prisoner's Dilemma with execution errors. Bottom left: A re- 
peated Prisoner's Dilemma with or without costly punishment. Bottom right: A repeated Public Goods Game 
with or without reward and/or punishment. Dot size is proportional to number of observations, which are 
indicated next to each dot. Error bars indicate standard error of the mean. 

prohibition against eating cows may increase the food supply: Harris, Bose, et al. (1966). 

blocking alternative routes to sexual gratification: Davidson and Ekelund (1997). 

divine will and chance: Dawkins (1986). 
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not about whether... but about why: Pinker (2002). 

altruism within groups could not have evolved: Choi and Bowles (2007); Bowles (2009). 
anthropologists studying small-scale societies: Henrich, Boyd, et al. (2001); Henrich, Gil-White, et al. 
(2001); Henrich, McElreath, et al. (2006); Henrich, Ensminger, et al. (2010). 

“Ultimatum Game”: Güth, Schmittberger, et al. (1982). 

“Wall Street Game” or the “Community Game”: Liberman, Samuels, et al. (2004). 

Americans tend to give nothing: List (2007). 

most cooperative .. . most willing to punish: Henrich, McElreath, et al. (2006). 

Dictator Game... involves no co-operation: The Dictator Game is about altruism, giving something for 
nothing. But from a mathematical, game-theoretical perspective, cooperation and altruism are (or can be) 
equivalent. This is because cooperation (the interesting kind) requires paying a personal cost to benefit others. 
To be cooperative is to be altruistic, and successful cooperation is just mutually beneficial altruism. (One no- 
table difference between the Dictator Game and true cooperation games such as the Prisoner's Dilemma and 
the Public Goods Game, however, is that the size of the pie is typically not fixed in true cooperation games. 
That is, true cooperation games are not "zero sum.") One might say that cooperation is not altruistic if one 
expects to get something of equal or greater value in return for one's contribution, and that's fair. But one can 
say the same for altruism. In one-shot interactions, cooperation is altruistic, and in repeated interactions nei- 
ther cooperation nor altruism is necessarily altruistic in the strongest sense. 

A more recent study: Henrich, Ensminger et al. (2010). 

cooperation and punishment in a set of large-scale societies: Herrmann, Thóni, et al. (2008). 

Figure 3.1: Adapted with permission from ibid. (2008). Here I show data from only nine of the sixteen cities 
studied to more clearly illustrate three prominent trends. 

punish cooperators on the first round: Ellingsen, Herrmann, et al. (2012). 

Figure 3.2: Adapted with permission from Herrmann, Thóni, et al. (2008). 

Greece . . . had become financially insolvent: BBC News (November 27, 2012). 

airing their prejudices: There is a long history of scholars presenting research that is suspiciously consistent 
with their own ideological and cultural commitments. Take, for example, the case of Ellsworth Huntington, 
an eminent early-twentieth-century geographer, Yale professor, and president of the board of directors of 
the American Eugenics Society. (Yes, they had a society.) Huntington believed that economic development is 
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determined primarily by climate. More specifically, he concluded that New Haven, Connecticut (home to 
Yale University), has a more or less ideal climate for intellectual innovation and economic development. 

And here I am, a secular Jew and professor at Harvard University, in metropolitan Boston, telling you 
that predominantly Muslim cities such as Rivadh and Muscat have cultures that thwart cooperation, while 
other cities have cultures that are highly conducive to cooperation—cCities such as, oh, let's say, Boston. 

Amid such suspicion, let me begin with three straightforward points about this research: First, I didn't 
conduct this research. Second, these results are not cherry-picked. As far as I know, there are no similar stud- 
ies showing substantially different results, and if you want to see for yourself, you can hop on Google Scholar 
and search for them. Third, the results presented above are mixed. Riyadh and Muscat come out near the 
bottom in this study of cooperative behavior, but so does Athens, the birthplace of democracy and the cradle 
of Western philosophy. And while it's true that my hometown comes out near the top, so does Bonn, not far 
from the former sites of Nazi concentration camps. But beyond this particular set of studies and my relation 
to them, there's a more general question about how we ought to respond to scientific research that makes 
some people look in some ways better than others, particularly when the research's proponents are among 
those who come out looking better. 

Let's start with the two extreme positions on this issue. At one extreme, we have complete deference: If 
someone with scientific credentials says that something is well supported by scientific evidence, then it must 
be true. For obvious reasons, this is not a good policy. At the other extreme, we have complete suspicion and 
skepticism: Anytime a scientist presents supposedly scientific research that makes some people look in some 
way better than others, we should be highly skeptical, and if the research makes its proponents look better 
than others, we should assume that it's just a bunch of politically motivated, self-serving, phony baloney. 

As you might expect, I think that our attitude should be somewhere in the middle. To be open- 
minded, we must allow for the possibility that cross-cultural research will reveal cultural differences that 
make some cultures look better than others— not better in some ultimate sense, but better in some ways. 
Moreover, we must allow for the possibility that researchers who discover such differences may be among 
those who end up looking better. (For all I know, Huntington might be right.) At the same time, we should 
bear in mind that scientists are people, and that like all people they are subject to bias, including uncon- 
scious bias. (See later in this chapter.) 

In reacting to cross-cultural social science, we should be clear about what follows from the science and 
what depends on our own moral assumptions. For example, the studies described above tell us that the people 
tested in Boston and Copenhagen made more money by cooperating in Public Goods Games than did the 
people tested in Riyadh and Athens. However, these studies don't tell us whether the people in Boston and 
Copenhagen played better or whether they have cultural attributes that are generally better to have. T hose are 
value judgments that go beyond the data. 

We should be aware that scientific studies may have serious flaws. (What if the people in Boston un- 
derstood the directions better than the people in Athens?) At the same time, we should have some respect 
for the scientific process. Scientific journals select papers for publication based on anonymous peer review, 
and— believe me— scientists are plenty critical of one another, especially when they're anonymous. Papers 
published in respectable journals may have serious flaws, but they are unlikely to have obvious flaws. (As it 
happens, in all of the studies described above, participants were tested to ensure that they understood the 
directions, which is standard practice in this kind of research.) 

In sum, bias in cross-cultural social scientific research is a legitimate concern, but the solution is not 
to dismiss all such research as biased political posturing. This is no better than blindly believing that ev- 
erything well-credentialed scientists have ever said is true. 
studies examining cultural differences among Americans: Cohen and Nisbett (1994); Nisbett and 
Cohen (1996). 

In surveys, southerners: Cohen and Nisbett (1994). 

“Southern ideas of honor": Fischer (1991). 

southern support for their anti-Soviet foreign policies: Lind (1999). 

based on cooperative agriculture: Nisbett, Peng, et al. (2001). 

American and Chinese... Magistrates and the Mob: Described in Doris and Plakias (2007). 

"corrupt mind": Anscombe (1958), cited in ibid. Note that Anscombe says this about killing an innocent 
person to quell the mob. It's not clear what she would say about imprisoning an innocent person. 

sensitive nature of these topics: See "airing their prejudices" above in this chapter. 

reading of the Koran to non-Muslims: Denmark TV2 (October 9, 2004) (translated with Google 
Translate). 

reward. .. to anyone who would behead “the Danish cartoonist”: Indian Express (February 18, 2006). 
boycotts of Danish goods cost... $170 million: BBC News (September 9, 2006). 

YouTube video: International Business Times (September 21, 2012). 
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“If someone sues you”: U.S. News & World Report (January 30, 1995), cited by Bazerman and Moore 
(2006), 74. 

both versions of the question: Hsee, Loewenstein, et al. (1999). 

experiments have documented this tendency: Walster, Berscheid, et al. (1973); Messick and Sentis (1979). 
“Performance-based pay is fair”: Van Yperen, van den Bos, et al. (2005). 

series of negotiation experiments: Babcock, Loewenstein, et al. (1995); Babcock, Wang, et al. (1996); 
Babcock and Loewenstein (1997). 

didn't know which side they would be on: Note the parallel with Rawls's (1971) “veil of ignorance.” 
better able to remember... material that supported their side: Thompson and Loewenstein (1992). 
biased fairness... environmental commons problem: Wade-Benzoni, Tenbrunsel, et al. (1996). 
negotiate over penalties for... criminals: Harinck, De Dreu, et al. (2000). 

tribalistic brand of biased fairness: Cohen (2003). 

It's all unconscious: The results of Cohen's study are fascinating and sobering, but I would be amazed if 
they generalized to issues in which partisan disagreements are qualitative rather than quantitative. For 
example, I doubt that partisan repackaging could reverse people's views on abortion or gay marriage, at 
least not in the short run. 

believed that Saddam Hussein had been personally involved: Millbank and Deanne (September 6, 
2003). 

2008 World Public Opinion poll: Reuters (September 10, 2008). 

students... watched footage from a football game: Hastorf and Cantril (1954). 

more confident in their views... considering the mixed evidence: Lord, Ross, et al. (1979). 

“hostile media effect”: Vallone, Ross, et al. (1985). 

people watched footage of protesters: Kahan and Hoffman (2012). 

consensus among experts: Intergovernmental Panel on Climate Change (2007); Powell (November 
15, 2012). 

Republicans believe: Jones (March 11, 2010), reporting on Gallup poll. 

commons problem of its own: Kahan, Wittlin, et al. (2011). 

Figure 3.3: Adapted with permission from Kahan, Peters, et al. (2012). 

In 1998, Republicans and Democrats .. . in 2010: Dunlap (May 29, 2008) and Jones (March 11, 2010), 
reporting on Gallup polls. 

deep geologic isolation: Kahan, Jenkins-Smith, et al. (2011). 

biased perception in the escalation of conflict: Shergill, Bays, et al. (2003). 

Figure 3.4: Adapted with permission from ibid. (2003). 

brain automatically anticipates: Blakemore, Wolpert, et al. (1998). 

only partially aware of the contributions of others: Forsyth and Schlenker (1977); Brawley (1984); 
Caruso, Epley, et al. (2006). 

As Steven Pinker explains: Pinker (2011). 

some of our biggest problems: Copenhagen Consensus Center (2012). 

“perfect moral storm": Gardiner (2011). 

any .number of arrangements: Singer (2004). 

the world's second-largest carbon emitter: Union of Concerned Scientists (2008), citing data originally 
compiled by the US Energy Information Agency (2008). 

“cleaning up the world's air”: Second presidential debate in 2000, quoted in Singer (2004), 26. 

"An attempt to point out": Fisher (1971), 113. 

“Officials think of themselves”: Ibid., 112. 

“Laying down the moral law”: Schlesinger (1971), 73. 
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Jeremy Bentham and John Stuart Mill: Mill (1861/1998); Bentham (1781/1996). The third of the great 
founding utilitarians is Henry Sidgwick (1907), whose exposition of utilitarianism is more thorough and 
precise than those of his more famous predecessors. Thanks to Katarzyna de Lazari-Radek and Peter Singer 
for highlighting many of the points on which Sidgwick anticipates points made here. 

without a girlfriend: Or boyfriend, as the case may be. 

theory of parental investment: Trivers (1972). 

in some birds and fish: Eens, M., & Pinxten, R. (2000). Sex-role reversal in vertebrates: Behavioural and 
endocrinological accounts. Behavioural processes, 511), 135-147. 

Peter Singer first posed it: Singer (1972). 
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Two rivers, twenty rivers: It all sounds the same: This attitude would make sense if the question were about 
making a small contribution to a larger (two-river or twenty-river) effort. But the question here is about how 
much vou would pav to have the whole job completed if somehow vour pavment alone would do it. 

mv first scientific publication: Baron and Greene (1996). 

heuristic thinking: Gilovich, Griffin, et al. (2002); Kahneman (2011). 

“The Trolley Problem”: Thomson (1985). The first papers on the Trollev Problem were by Philippa Foot 
(1967) and Thomson (1976). This gave rise to a large literature in ethies. See Fischer and Ravizza (1992); 
Unger (1996); and Kamm (1998, 2001, 2006). 

wrong to push the man off the footbridge: Thomson (1985); Petrinovich, O'Neill, et al. (1993); Mikhail 
(2000, 2011); Greene, Somerville, et al. (2001). 

“Actso that you treat humanity": Kant (1785/2002). This is the second of four formulations of the categori- 
cal imperative described in the Groundwork. 

people all over the world agree: O'Neill and Petrinovich (1998); Hauser, Cushman, et al. (2007). 

the case of Phineas Gage: See Damasio (1994) and Macmillan (2002). 

due to emotional deficits: Saver and Damasio (1991); Bechara, Damasio, et al. (1994). 

“to know, but not to feel”: Damasio (1994), 45. 

Cognitive control: Miller and Cohen (2001). 

color-naming Stroop task: Stroop (1935). 

enabled by .. . DLPFC: Miller and Cohen (2001). 

fMRI: fMRI uses an MRI scanner of the sort routinely used in modern hospitals. For most clinical purposes, 
an MRI takes a still, three-dimensional picture of the body, a "structural scan.” f MRI takes “movies” of the 
brain in action. The movies have a modest spatial resolution, composed of "voxels" (volumetric pixels) of about 
2 to 5 millimeters. The temporal resolution is very low, with an image (a “frame” in the movie) acquired about 
once every 1 to 3 seconds. The images produced by f MRI look like pixilated blobs, which are typically over- 
laid on top ofa higher-resolution structural scan, allowing one to see where the blobs are in the brain. The 
blobs are not the direct result of “looking” at the brain. They are the products of statistical processing. What 
a blob in a brain region typically means is that there is, on average, more “activity” in that region when some- 
one is performing one task (e.g., looking at human faces) as compared with another task (e.g., looking at ani- 
mal faces). The “activity” in question is the electrical activity of neurons in the brain, but this activity is not 
measured directly. Instead, it's measured indirectly, by tracking changes in the flow of oxygenated blood. For 
more information, see Huettel, Song, et al. (2004). 

including parts of the VMPFC: Greene, Somerville, et al. (2001). Many other brain regions exhibited ef 
fects in this contrast, including most of what is now called the "default network" (Gusnard, Raichle, et al., 
2001). Many of these regions appear to be involved not in emotional response per se, but in the representation 
of nonpresent realities (Buckner, Andrews-Hanna, et al., 2008). 

Our second experiment: Greene, Nystrom, et al. (2004). 

We addressed this question in later work: Greene, Cushman, et al. (2009). 

ice cream doesn't cause drowning: l don't know who first used this example. 

follow-up studies of our own: Some philosophers have raised doubts about the evidence for the dual-process 
theory (McGuire, Langdon, et al., 2009; Kahane and Shackel, 2010; Kahane, Wiech, et al., 2012; Berker, 
2009; Kamm, 2009). For replies, see Paxton, Bruni, and Greene (under review); Greene (2009); and Greene 
(under review). For further details on Berker, see a set of notes (Greene, 2010) assembled for a conference at 
Arizona State University, available on my webpage or by request. 

patients with... (FTD): Mendez, Anderson, et al. (2005). 

dilemmas .. . patients with VMPFC damage: Koenigs, Young, et al. (2007); Ciaramelli, Muciolli, et al. 
(2007). 

sweaty palms: Moretto, Ladavas, et al. (2010). 

same conclusion: See also Schaich Borg, Hynes, et al. (2006); Conway and Gawronski (2012); Trémolière, 
Neys, et al. (2012). 

turning the trolley onto family members: Thomas, Croft, et al. (2011). 

Low-anxiety psychopaths: Koenigs, Kruepke, et al. (2012). See also Glenn, Raine, et al. (2009). 

alexithy mia: Koven (2011). 

physiological arousal . . . fewer utilitarian judgments: Cushman, Gray, et al. (2012). See also Navarrete, 
McDonald, et al. (2012). 

gut feelings: Bartels (2008). 

Inducing people to feel mirth: Valdesolo and DeSteno (2006); Strohminger, Lewis, et al. (2011). 

the amygdala: Adolphs (2003). 

psychopathic tendencies: Glenn, Raine et al. (2009). 

amygdala... correlates negatively with utilitarian judgments: Shenhav and Greene (in prep.). 
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citalopram .. . fewer utilitarian judgments: Crockett, Clark, et al. (2010). 

lorazepam has the opposite effect: Perkins, Leonard, et al. (2012). 

role of visual imagery: Amit and Greene (2012). 

“Do whatever will produce the most good”: By this I don't mean that people who make utilitarian judg- 
ments are card-carrying utilitarians, subscribing to the full philosophy. I mean only that they are applying an 
impartial “cost-benefit” decision rule. 

DLPFC. .. success in the Stroop task: MacDonald, Cohen, et al. (2000). 

brain imaging studies... similar results: Shenhav and Greene (2010); Sarlo, Lotto, et al. (2012); Shenhav 
and Greene (in prep.). 

simultaneous secondary task: Greene, Morelli, et al. (2008). See also Trémoliére, Neys, et al. (2012). 
removing time pressure and encouraging deliberation: Suter and Hertwig (2011). 

experience of being led astray: Method follows Pinillos, Smith, et al. (2011). 

tricky math problems: Frederick (2005). 

people who solved these tricky math problems: Paxton, Ungar, and Greene (2011). In the case of the foot- 
bridge dilemma, the tricky math problems didn't change people's judgments. Instead, we found that people 
who were generally better at solving the tricky math problems gave more utilitarian judgments in response to 
the footbridge case. See also Hardman (2008). Paxton and I also used the CRT method with a “white lie di- 
lemma” devised by Kahane, Wiech, et al. (2012), a case in which the non-utilitarian response was alleged to 
be counterintuitive. Our results indicate the opposite, consistent with the original dual-process theory. See 
Paxton, Bruni, and Greene (under review). 

people who generally favor effortful thinking: Bartels (2008); Moore, Clark, et al. (2008). 

moral reasons of which people are conscious: Cushman, Young, et al. (2006). 

justifying that judgment in a consistent way: Ibid.; Hauser, Cushman, et al. (2007). 

on a molecular level: Crockett, Clark, et al. (2010); Perkins, Leonard, et al. (2010); Marsh, Crowe, et al. 
(2011); De Dreu, Greer, et al. (2011). 

moral judgments of medical doctors: Manuscript in preparation, based on Ransohoff (2011). For a review 
of bioethical issues from a neuroscientific perspective, see Gazzaniga (2006). 

minimize the risk of actively harming: It's often said that the Hippocratic Oath, taken up by doctors upon 
entering the profession, commands them to "First, do no harm." However, these words don't actually appear in 
the oath. See: hetp://www.nlm.nih.gov/hmd/greek/greek oath.html. 
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Everything Bug: Winner (2004). 

one of the most important ideas to emerge: Posner and Snyder (1975); Shiffrin and Schneider (1977); 
Sloman (1996); Loewenstein (1996); Chaiken and Trope (1999); Metcalfe and Mischel (1999); Lieberman, 
Gaunt, et al. (2002); Stanovich and West (2000); Kahneman (2003, 2011). 

Thinking, Fast and Slow: Kahneman (2011). 

get rid of the concept of “emotion”: Griffiths (1997). 

but it's not emotional: Such processing may trigger emotional responses, but the visual processing itself is 
not emotional. 

action tendencies: Darwin (1872/2002); Frijda (1987); Plutchik (1980). 

Fear... enhancing the sense of smell: Susskind, Lee, et al. (2008). 

influenced ... decisions by influencing their moods: Lerner, Small, et al. (2004). 

“slave of the passions”: Hume (1739/1978). 

cannot produce good decisions without... emotional input: VMPFC patients like Phineas Gage are, in 
general, very bad decision makers. They can give reasons for choosing one thing over another, and the reasons 
they give often sound good. But these reasons are fragmented. Instead of adding up to a good decision, they 
float free in a jumble, resulting in foolish behavior. (See Damasio, 1994.) In a telling experiment, Lesley 
Fellows and Martha Farah (2007) showed that VMPFC patients are more likely than others to exhibit “intran- 
sitive' preferences—that is, to say that they prefer A to B, B to C, and C to A. With respect to decision making, 
this is the hallmark of irrationality. What's more, the DLPEC, the seat of abstract reasoning, is deeply intercon- 
nected with the dopamine system, which is responsible for placing values on objects and actions (Rangel, 
Camerer, et al., 2008; Padoa-Schioppa, 2011). From a neural and evolutionary perspective, our reasoning 
systems are not independent logic machines. They are outgrowths of more primitive mammalian systems for 
selecting rewarding behaviors— cognitive prostheses for enterprising mammals. In other words, Hume seems 
to have gotten it right. 

fruit salad or chocolate cake: Shiv and Fedorikhin (1999). 

two different kinds of decisions: McClure, Laibson, et al. (2004). 


yielding immediate rewards: Here the immediate rewards are not so immediate. In a later study, using food 
rewards (McClure, Ericson, et al., 2007), they were more immediate. 

Figure 5.1: Images adapted with permission from Ochsner, Bunge, et al. (2002); McClure, Laibson, et al. 
(2004); and Cunningham, Johnson, et al. (2004). 

intrapersonal .. . interpersonal: Nagel (1979). 

we see the same pattern: Cohen (2005). 

reinterpret the pictures in a more positive way: Ochsner, Bunge, et al. (2002). 

presented white people with pictures: Cunningham, Johnson, et al. (2004). 

interacting with a black person ... cognitive load: Richeson and Shelton (2003). 

automatic settings that tell us how to proceed: Bargh and Chartrand (1999). 

amygdala... 1.7 hundredths of a second: Whalen, Kagan, et al. (2004). 

VMPEC... decisions involving risk: Bechara, Damasio, et al. (1994); Bechara, Damasio, et al. (1997); 
Damasio (1994). 

as revealed in their sweaty palms: Small differences in palm sweat can be detected by passing a small cur- 
rent through the skin, which conducts current more effectively when moist. This technique is known as the 
measurement of “skin conductance response” (SCR) or “galvanic skin response” (GSR). 

Figure 5.2: Adapted with permission from Whalen, Kagan, et al. and Rathmann (1994). 

we need our emotional automatic settings: Woodward and Allman (2007). 

shaped by cultural learning: Olsson and Phelps (2004, 2007). 
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within-group cooperation: A nd also within-group competition. 

“moral relativist': Í here refer to relativism in the colloquial sense. In philosophy, relativism can be rather 
different. See Harman (1975). 

“pragmatism” often has a different meaning: Pragmatist theories of truth are, roughly, ones according to 
which claims are true or false depending on the practical effects of believing in them. 

make things go as well as possible: Strictly speaking, Lam talking about act consequentialism. 

earliest opponents of slavery: Driver (2009). 

two centuries' worth of philosophical debate: Smart and Williams (1973). 

the value that gives other values their value: Mill (1861/1987), chap. 4, 307-314; Bentham 
(1781/1996), chap. 1. 

“It is better to be a human being dissatisfied”: Mill (1861/1998), 281. 

an argument that Mill dashes off in passing: Ibid., 282-283. 

“broaden and build”: Fredrickson (2001). 

Measuring happiness: Easterlin (1974); Diener, Suh, et al. (1999); Diener (2000); Seligman (2002); Kahne- 
man, Diener, et al. (2003); Gilbert (2006); Layard (2006); Stevenson and Wolfers (2008); Easterlin, McVey, 
etal. (2010). 

science of happiness excels: See previous note. 

unemployment is often emotionally devastating: Clark and Oswald (1994); Winkelmann and Winkel- 
mann (1995); Clark, Georgellis, et al. (2003). 

making a bit less money: Here the debate is between those who say that additional money for the well-off 
buys no additional happiness (Easterlin, 1974; Easterlin, McVey, et al., 2010) and those who say that it buys 
some but not much (Stevenson and Wolfers, 2008). At best, happiness seems to increase as a logarithmic 
function of income, meaning that gaining another unit of happiness requires ten times more income than it 
took to gain the last unit. 

we may soon have such measures: At least for happiness in the moment. Neural measures of life satisfaction 
pose a far greater challenge. 

This stereotype .. . is undeserved: Mill (1861/1998), 294. 

attempt to outcalculate .. . at our peril: Ibid., 294-298; Hare (1981); Bazerman and Greene (2010). 
down to first principles: There is a sense in which utilitarians are more closely aligned with ideological col- 
lectivists than with ideological individualists. Both utilitarians and ideological collectivists aim for the 
greater good. The difference is that ideological collectivists are committed to a collectivist way of life as a 
matter of first principles. In contrast to both utilitarians and ideological collectivists, ideological individual- 
ists do not aim for the greater good per se. If some people are foolish and lazy and they get less, that's perfectly 
fine with individualists, even if their getting less reduces aggregate happiness. For ideological individualists, 
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the goal is not to maximize happiness but to give people the happiness or unhappiness they deserve. The utili- 
tarian take on communism follows the old quip “Great in theory, terrible in practice.” Ideological individual- 
ists won't even say “Great in theory.” 

values... derive their value from their effects on our experience: See Sidgwick (1907), 401. 

no impact on our experience... would not be valuable: This statement and the one preceding it are not, 
in fact, equivalent. It could be that all values must have an impact on our experience in order to be valuable, 
but from this it doesn't follow that the value of a value is derived solelv from its impact on our experience. In 
other words, impact on experience may be necessary for having value, but not sufficient for determining the 
value of a value. 

second utilitarian ingredient is impartialitv: Sidgwick (1907) calls this the axiom of justice. 

connection between manual-mode thinking and utilitarian thinking: This association has been chal- 
lenged by Kahane, Wiech, et al. (2012). They argue that manual-mode thinking favors utilitarian judgments 
in some cases—like the footbridge dilemma— but not in general. To make this point, they conducted a neu- 
roimaging study using a new set of dilem mas in which, according to them, the deontological judgment (the 
nonutilitarian judgment favoring rights or duties over the greater good) is less intuitive than the utilitarian 
judgment. However, Joe Paxton, Tommaso Bruni, and I have since conducted an experiment that casts seri- 
ous doubt on their conclusions, which were not well supported by the neuroimaging data to begin with 
(Paxton, Bruni, and Greene, under review). We used something called the Cognitive Reflection Test 
(Frederick, 2005), which can both measure and induce (Pinillos, Smith, et al., 2005) reflective thinking, to 
test one of their new dilemmas. This isa "white lie" case in which the greater good is served by telling a lie. 
As a control, we tested one of our standard footbridge-like dilemmas. We showed that in both cases, being 
more reflective is associated with more utilitarian judgment. This is a striking victory for the dual-process 
theory presented here, because it employs a dilemma that both I (Greene, 2007) and these critics thought 
would work as a counterexample. 

the amygdala and the VMPFC: Actually, the situation is a bit more complicated. Current research suggests 
that the amygdala functions more like an alarm bell, while the VMPFC is actually more of an integrator of 
emotional signals, translating motivational information into a common affective currency (Chib, Rangel, et 
al., 2009). Thus, VMPFC damage may block the influence of automatic settings by blocking the route by 
which they influence decisions. Decision rules applied by the DLPFC can influence the affective integration 
in the VMPFC (Hare, Camerer, et al., 2009), but such rules can also be applied without the VMPFC. See 
Shenhav and Greene (in prep). 

ambiguous Golden Rule: The Golden Rule is ambiguous because people's situations are always different, and 
the Golden Rule doesn't tell us which situational differences justify differences in treatment. For almost any 
disparity in treatment, one can find a formally impartial rule that justifies it: "Yes, and if you were king, and 7 
were a peasant, then you would have the right to do whatever you want to me!” The Golden Rule works only 
when there is agreement about which features of our situations matter morally. In other words, the Golden 
Rule doesn't set the terms of cooperation. It just says that pure selfishness, as in "I get more just because I'm 
me,” is not allowed. When it comes to resolving conflicts, that's not very helpful, because, as explained in 
chapter 3, no tribe's values are purely selfish. 
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aware of this problem: Obama (2006) continued: “Now this is going to be difficult for some who believe in the 
inerrancy of the Bible, as many evangelicals do. But in a pluralistic democracy, we have no choice. Politics de- 
pends on our ability to persuade each other of common aims based on a common reality. It involves the compro- 
mise, the art of what's possible. At some fundamental level, religion does not allow for compromise. It's the art 
of the impossible. If God has spoken, then followers are expected to live up to God's edicts, regardless of the 
consequences. To base one's life on such uncompromising commitments may be sublime, but to base our policy 
making on such commitments would be a dangerous thing." 

“only people of non-faith can... make their case”: See Greenberg (February 27, 2012). Santorum was 
responding directly to President Kennedy's views, which were similar to Obama's. 

Rights... trump consequences: Dworkin (1978). 

For many modern moral thinkers: Kant (1785/2002); Hare (1952); Gewirth (1980); Smith (1994); Kors- 
gaard (1996). See also a forthcoming book (still untitled) by Katarzyna de Lazari-Radek and Peter Singer in 
which they, inspired by Henry Sidgwick, defend utilitarianism as an axiomatizable system. 

Other tribes say that earthquakes: Espresso Education (n.d.). 

whether or not it's the moral truth: What do we mean by "works?" How can we say whether a metamorality 
"works" without applying some kind of evaluative standard? And how can we apply such a standard without 
assuming some kind of moral truth or, at least, a metamorality? We'll discuss this problem in more detail later, 
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but for now the short answer is this: A metamoralitv “works” if we're generally satisfied with it. And one 
metamorality works better than another if, in general, we're more satisfied with it. An analog y here is with law. 
You don't have to believe "Thou shalt not drink under twenty-one” is the moral truth to be satisfied with a law 
setting the legal drinking age at twenty-one. And different people can be satisfied with such a law for different 
reasons. General satisfaction with a moral system does not presuppose agreement on moral first principles. 
Plato: Plato's Euthyphro, in Allen and Platon (1970). 

How can we know God's will?: Craig and Sinnott-Armstrong (2004). 

open letter to Dr. Laura: The letter is available on many websites in many forms. For one reprinting and a 
discussion of its origins, see Snopes.com (November 7, 2012). 

"Abraham is ordered by God": Obama (2006). 

reflection discourages belief: Shenhav, Rand, and Greene (2012); Gervais and Norenzayan (2012). 

most of them, atleast: Of course, some religions are less tribalistic than others. A decided ly untribal religion 
is the Unitarian Universalist church. 

“pure practical reasoning": Kant (1785/2002). 

views that can't be rationally defended: Of course, some people are committing rational errors, maintain- 
ing sets of moral beliefs that are internally inconsistent. But the hard-line rationalist believes that some spe- 
cific moral conclusions (as opposed to combinations of conclusions) could never be rationally defended. This 
requires that morality be like math, with substantive conclusions derivable from self-evident first principles. 
More on this shortly. 

manageable set of self-evident moral truths: | say “manageable” because morality is not like math if the axi- 
oms are an enormous set of statements too expansive to be written down. 

no one has found... axioms: Why has no one found such axioms? What kind of principles would make 
good axioms? Given that the axioms need to be self-evident, we might hope for axioms that are "analytic," 
that is, true by virtue of the meanings of the words used to express them. (The validity of the analytic/ 
synthetic distinction was famously questioned by Quine [1951], but it seems very hard to get by without it 
[Grice and Strawson, 1956] ) 

For example, the statement "All bachelors are unmarried" is analytic. You might say that analytic state- 
ments are "true by definition," with the caveat that the truth of some analytic statements may be nonobvious, 
especially if they are long and complicated. It's also possible to have self-evident truths that are not analytic— 
for example, Euclid's axiom stating that it's possible to connect any two points with a straight line. This isobvi- 
ously true, but there's nothing in the definitions of "point" and "two" from which one can derive this truth. Put 
another way, the concept POINT does not contain the concept STRAIGHT (or the concept LINE) in the way 
that the concept BACHELOR contains the concept UNMARRIED. Thus, using Euclid's as our model, we 
might hope to find moral axioms that are self-evidentiv true but not true by definition. Or we might hope to 
find axioms that are true by definition. If we're looking for moral axioms, those are our options. 

The early-twentieth-century philosopher G. E. Moore (1903/1993) put forth an argument, known as 
the Open Question Argument, that provides a test for aspiring moral axioms. We can start by thinking of the 
Open Question Argument as a test for self-evidence, although that's not how Moore thought of it. (Moore 
thought that propositions that failed the test couldn't be true, but he overlooked the possibility that they 
could be true but not self-evidently or obviously true.) A test for self-evidence is what we need if we're looking 
to model morality on math, because, once again, the moral axioms need to be self-evident. 

Moore's test works as follows. Take a moral principle that purports to tell you what sorts of things are 
right, wrong, good, bad, etc. For example, a utilitarian principle like this one: 

What's right is what maximizes overall happiness. 

If you have utilitarian inclinations, you might think that this principle is not only true but also self- 
evident. To you, Moore poses the following challenge: Suppose we know that a certain action will maximize 
overall happiness. Isn't it still an open question whether the action is right? If the answer is yes, then it can't be 
self-evident that what maximizes happiness is what's right. In this case, you can feel the pull of Moore's Open 
Question Argument by considering counterexamples. Take the case of pushing the man off the footbridge to 
save the five. Let's grant that this action will maximize overall happiness. Have we then granted that it's right? 
Clearly not. The moral question remains open for now, regardless of what we may conclude in the end. 

Let's try an even more abstract principle. This one is borrowed, with liberties taken, from Michael 
Smith (1994): 

What's right is what we would want if we were fully informed and fully rational. 

This principle may seem to be self-evidently true, but is it really? Suppose we have an action that is 
favored by someone who is fully informed and fully rational. Is it not an "open question" whether this action 
is righe? 

Think, for example, of your classic evil masterminds, such as Hannibal Lecter. Maybe it's true that a 
baddie like Lecter, who kills and eats innocent people, must be making some kind of logical error, or must be 


ignorant of some nonmoral facts. Maybe, but maybe not. The point is that it's not self-evident that this is so. 
Shaun Nichols has shown that many ordinary people believe that psychopaths know right from wrong but 
simply don't care, consistent with the idea that one can be morally deficient without being irrational or non- 
morallv ignorant (Nichols, 2002). Even if we become fullv informed and fullv rational, it's still an 'open 
question' whether we have therefore become morallv perfect. And that means that the principle above can't 
be self-evident. It may appear to be self-evident (to some of us, at any rate), because we think that being more 
rational and more informed can only help. But that's very different from saving that full rationalitv and full 
information are, self-evidently, all you need for perfect moral judgment and motivation. We could be fully 
informed and fully rational and still make some moral mistakes. In any case, it's not self-evident that what I 
just said is false. And that means that the above principle can't be a moral axiom because, even if it's true, it's 
not self-evidently true. 

What's more, even if we were to accept this kind of very abstract principle as an axiom, it wouldn't give 
us a common currency. It wouldn't tell us how to make trade-offs among competing values. It would simply 
tell us that the right trade-offs are the trade-offs we would make if we were fully informed and fully rational, 
which is not much help. 

Moore thought that, for any moral principle, the question it purports to answer would always remain 
open. To see why, we need to think about what a moral principle is. For Moore, a moral principle is one that 
connects a "natural property" to a “moral property." Take, for example, the principle "Lying is wrong." An 
action's being an instance of telling a lie is a "natural property" of that action. An action's being wrong is a 
"moral property" of that action. And what the principle "Lying is wrong" means, in property-speak, is this: 
If an action has the natural property of being an instance of lying, then it has the moral property of being 
wrong. What Moore's Open Question Argument suggests is that ascribing natural properties to things will 
never get us all the way to moral properties, at least not in a way that is self-evident. (Moore's terminology 
implies that moral properties must be "unnatural," but this is not an essential part of his argument. Instead 
of speaking about "natural" properties, we can instead speak about apparently factual properties that can be 
ascribed without controversy, the "facts of the case,” as lawyers say.) 

Suppose that Joe lied to the police in order to protect his friend. We disagree about whether this is 
wrong. It is, however, a noncontroversial "fact of the case" that Joe lied. From this fact, are we forced to 
conclude that what Joe did is wrong? No, says Moore. It's an "open question." Moore argues that all substan- 
tive moral principles—not just "Lying is wrong"—have the same limitation. The reason is that all substantive 
moral principles must span the is-ought gap, with the "natural properties" (the noncontroversial facts of the 
case) on one side and the “moral properties" on the other. The facts of the case are always about what "is" — 
facts like the fact that Joe lied. Moral conclusions, in contrast, are always about what "ought" to be, such as 
the fact that Joe ought not to have lied. Now, it may be true that lying is wrong, but the key point here is that 
this moral principle can't be self-evidently true. Why? Because even if we agree that Joe lied (a fact about what 
"is"), its still an open question whether this act of lying was wrong (a fact about what "ought" to be). 

“Lying is wrong” is not self-evidently true, but that's just one candidate. Maybe there are other familiar 
moral principles that are self-evidently true. We might start with a principle concerning something that seems 
obviously and unconditionally wrong. How about this: "Torturing kittens is wrong." Isn't it self-evident that 
it's wrong to torture kittens? Well... What if the only way to save a million people is to torture one kitten? 
Would that be wrong? And is it self-evident that it's wrong? Perhaps we need a little tweak: " Torturing kittens 
is wrong, unless you have a really good reason." But what's a "really good reason"? One that's good enough to 
justify torturing a kitten? If so, then we have, instead of a substantive moral principle, an empty tautology: 
"Torturing kittens is wrong unless there is a reason sufficient to justify kitten torturing." We could attempt 
to be more specific. But how much good does your kitten torturing have to do? And how does the amount of 
good vary with the amount of torture? And are there answersto these questions that are self-evidently correct? 
Perhaps, with enough tweaking, we can get a moral statement about kitten torturing (or whatever) that passes 
the open-question test. But what we're going to end up with is not a moral axiom, a foundational principle 
from which more specific moral truths can be derived. Rather, it's going to be a very specific and highly quali- 
fied statement about the ethics of torturing kittens (or whatever). 

We've been talking about the Open Question Argument as a test for self-evidence, and self-evidence is 
what we need from our axioms. But strictly speaking, a statement can be self-evidently true even if it's being 
true remains an "open question." How? Consider this statement: All bachelors are not not not not not not not 
not not not not married. Unless you counted the nots, the truth of the previous sentence is, for you, an open 
question. It turns out that this sentence is true, and it's self-evidently true, meaning that you don't need any 
evidence beyond what's in the sentence to verify that it's true. Thus, strictly speaking, a statement can be 
self-evident even if its truth is an open question. And, thus, the Open Question Argument is not, strictly 
speaking, a test for self-evidence. Rather, it's a test for something more like "obviousness." This leaves open 
the possibility that there are useful moral axioms that are self-evidently true but not obviously true. What 
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would such a principle be like? Unlike the “not not” sentence above, such a principle would not be reducible 
to something simpler. Otherwise the simpler version could be used as the axiom. Thus, such a principle would 
have to be an irreducibly complex moral statement that can be seen as true without any further evidence or 
argument, but whose truth is not obvious, due to its complexity. And from this statement (along with others 
like it, perhaps) and nonmoral facts, we will be able to derive answers to controversial moral questions. I can- 
not prove that moral axioms of this kind do not exist, but it's fair to say that we should not count on their 
arriving anytime soon. 

In sum, the prospects for modeling morality on math don't look good. To pull this off, we'll need moral 
axioms that are both self-evident and useful, but there don't seem to be any such axioms around. To be useful, 
moral principles must enable us to connect the “is” to the “ought,” taking us from the “facts of the case” to 
specific moral answers. And principles that are powerful enough to do that don't seem to be self-evident, how- 
ever plausible they may be. I cannot prove that morality will never be axiomatized, and therefore made like 
math. But we best not hold our collective breath. 

P.S. Katarzyna de Lazari-Radek and Peter Singer have argued (in an unpublished and untitled book 
manuscript) that utilitarianism rests on a set of self-evident axioms. Their argument, which is inspired by 
Henry Sidgwick (1907), is, in my opinion, about as compelling as such arguments get. But in the end I can't 
agree, for reasons suggested by the foregoing discussion. 
competition between groups: Once again, I’m not assuming a group-selectionist account of moral evolution. 
Here, a "group" may consist of two people, a tribe of thousands, or anything in between. 
favor people with genocidal tendencies: Joyce (2011). 
argument, which is controversial, also applies to cultural evolution: Casebeer (2003). See also Ruse and 
Wilson (1986) and a rebuttal by Kitcher (1994). Suppose that what evolved biologically was not morality, but 
a general capacity to acquire cultural practices. And suppose that morality evolved purely culturally, mean- 
ing that it is a set of “memes” (cultural variations) that spread because morality outcompeted other memes in 
the struggle for existence in human brains. In that case, the same argument still applies. The ultimate func- 
tion of morality would then be to make more copies of itself in the brains of other humans, rather than to 
make more copies of its associated genes. Moral tendencies might spread simply because they are good at 
"infecting" brains, rather like catchy tunes and conspiracy theories. Or they might survive because they help 
their hosts survive. More specifically, moral memes might survive because they help their hosts outcompete 
the competition. But whatever the case, and whether or not morality does some good along the way, the bot- 
tom line of cultural evolution is the spreading of cultural memes, just as the bottom line of biological evolu- 
tion is the spreading of genes. 
the "is-ought" problem: Hume (1739/1978). 

“naturalistic fallacy": According to G. E. Moore (1903/1993), who coined the term, the naturalistic fallacy 
is to infer that an entity is good from facts about its "natural" properties—for example, inferring that choco- 
late is good because it is tasty. 

social Darwinists: The term "social Darwinism" is used primarily as a pejorative. It is often attributed, 
rather unfairly, to Herbert Spencer. Insofar as Social Darwinism existed as an ideology, it was in the minds 
of elite capitalists who saw in Darwin confirmation of their preexisting moral and political beliefs. See 
Wright (1994). 

I thought this was the question: Greene (2002). 

Whatreally matters... path through the morass: Thanks to Walter Sinnott-A rmstrong, Peter Singer, and 
Simon Keller for pressing me on this point. 

Do we call what's left "the moral truth"?: Here's the dilemma: On the one hand, it seems that some moral 
views are clearly better than others. If a moral position is internally inconsistent, or if its appeal depends on 
false assumptions, then such a view is in some sense objectively inferior to others that lack such problems. But 
if we believe in “objectively better" and "objectively worse,” then why not believe in “objectively right”? Why 
not say that the moral truth is just whatever our moral beliefs become after we've objectively improved them 
as much as possible? 

On the other hand, you might think that moral truth requires more than postimprovement agreement. 
(See Mackie, 1977; Horgan and Timmons, 1992; and Joyce, 2001, 2006.) If what you believe is truly true, 
then it should be impossible for someone to disagree with you without making some kind of objective mis- 
take. Suppose that a well-informed, perfectly rational psychopath— one whose thinking meets our standards 
for "fully improved "—disagrees with us about, say, the wrongness of torturing kittens. There are two possi- 
bilities. First, we might deny that such a person could exist. If his thinking is fully objectively improved, we 
say, then he must agree that torturing kittens is wrong. But on what grounds can we say that? This is the kind 
of thing that we can say only if we have direct access to moral truth, which we apparently don't have. Our 
other option is to accept that a psychopath with fully improved moral thinking (knows all the facts, no inter- 
nal inconsistencies, etc.) could exist. But this means that someone can reject the moral truth without making 


(in any non-question-begging sense) a mistake. But that doesn't sound like truth. It's like saying this: "It's true 
that the sun is larger than the earth, but if you think that the sun is not larger than the earth, you're not neces- 
sarily wrong." Huh? 

So is there moral truth? In my dissertation (Greene, 2002), I argued that there isn't any moral truth, 
for the reasons given "on the other hand" above. But now I think that what matters most for practical pur- 
poses is the possibility of objective improvement, not the possibility of objective correctness. A nd this inclines 
me to say that, for practical purposes, there can be something very much like moral truth (Blackburn, 1993), 
which might more or less be the moral truth, if not the Moral Truth. But, really, I think it's the wrong ques- 
tion on which to focus, which is why I've paid it relatively little attention in this book. What matters is what 
we do with the morass, not whether we call the final product the "moral truth." 

189 atthe highest level: “At the highest level” is key. Almost no one thinks that we must be completely impartial 
in a day-to-day sense, caring for strangers no less than we care for ourselves and our loved ones. But at the 
same time, we all recognize that, from a moral perspective, we must all be subject to the same rules, even as 
we occupy different positions within the system established by those rules. If I'm allowed to favor my loved 
ones over strangers, then so are you, so long as our positions are symmetrical. And if I'm allowed to favor mine 
more than you're allowed to favor yours, it's because we occupy objectively different positions (e.g., a presi- 
dent of a private club vs. a federal judge). In short, we're allowed to be partial at a low level, but the rules that 
define when and where partiality is acceptable must be applied impartially. 

189 "moral truth" .. . an open question: See note "Do we call what's left ‘the moral truth ?". 
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episode of The Twilight Zone: The episode (Medak, 1986), written by Richard Matheson, was based on his 
earlier short story and was the basis for the movie The Box. 

"If all else is equal”: We're assuming that there is no hidden upside here. Breaking your kneecap won't im- 
prove your character. You won't meet the love of your life in the hospital. Here, breaking your kneecap is just 
an unmitigated reduction in your happiness that you can avoid by pushing the button. 

go out and check: At the very least, I expect at least some members of all tribes to follow the utilitarian logic 
within the tribe. There may be some tribes that are so tribalistic that they are essentially psychopathic at the 
intertribal level. But as noted above, if that's how they are, they are simply not part of the “we” of this conver- 
sation. Atleast not yet. As noted in chapter 3, kindness toward strangers seems to be supported, if not created, 
by modern market societies (Henrich, Ensminger et al., 2010). In testing this conjecture, methods will have 
to be tailored to the population(s) being tested. 

substantial moral common ground: You might disagree. You might observe that “if all else is equal,” com- 
mitments are a dime a dozen. We're all opposed to lying, ifall else is equal. We're all in favor of letting people 
spend their money however they please, if all else is equal. And so on. In other words, many values, perhaps 
most values, are shared to some extent, and something that we all value to some extent is something to which 
we're all committed "if all else is equal." Conflict arises primarily because people prioritize different values in 
different ways. Thus, there's nothing special about our "if all else is equal” commitment to maximizing hap- 
piness. We have "if all else is equal” commitments to many, many values. The problem is that all else is never 
equal. 

It is indeed true that "ifall else is equal" moral commitments are easy to come by. Nevertheless, our "if 
all else is equal" commitment to maximizing happiness is special. "No lying" is not a moral system. Nor is 
"Spend your money however you want," and so on. By contrast, "Maximize happiness" is a moral system. 
Why is it a system? Because a commitment to maximizing happiness tells us how to prioritize different 
values—in other words, how to make trade-offs. It gives us answers to questions such as "When is it permis- 
sible to lie?" and "When does economic freedom go too far?" and so on. Thus, our "if all else is equal" com- 
mitment to maximizing happiness is not just a default commitment to one among many moral values. It's a 
default commitment to what is, or could be made into, a complete system of moral values. That's profoundly 
important. 
objections . . . ultimately driven by automatic settings: The key word here is ultimately. I understand that 
there are some abstract, theoretical arguments against utilitarianism. My claim, however, is that these theo- 
ries are ultimately motivated by gut feelings. See chapter 11. 
make the world that way: Russell and Norvig (2010). 
simple kind of problem solver is a thermostat: Dennett (1987). 
what the human PFC does: Miller and Cohen (2001). 
recognize these errors aserrors: Kahneman (2011). 
one way to get... impartiality: For developments of this idea, see Gauthier (1987) and Boehm and Boehm 
(2001) on egalitarianism in hunter-gatherer societies. 
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The Expanding Circle: Singer (1981). 

does not entail abandoning one's subjective reasons: Here, there may be no objective reason to favor 
one's self, but, for all we've said, there's no objective reason not to favor one's self. One might conclude 
that, objectively speaking, all concerned are equally entitled to be completely selfish. 

empatby, the ability to feel what others feel: Batson, Duncan, et al. (1981); Hoffman (2000); Decetv 
and Jackson (2004); de Waal (2010). 

to choose one's finger: Smith (1759/1976), section 111.3.4; Pinker (2011), 669-670; and Bloom (in 
press) make the same point, also citing Smith. 

According to John Rawls: Rawls (1971). 

save a life for about $2,500: Givewell.org (n.d.) 

Against Malaria Foundation: Ibid. 

spend that money helping desperately needy people: Singer (1972, 2009); Unger (1996). 

not the only un-splendid implications: Utilitarianism has other famously counterintuitive implica- 
tions. First, it fails to distinguish between natural and artificially generated experience (Nozick, 1974). 
Second, it allows sufficiently large numbers of individuals (e.g., rabbits) with minimally positive experi- 
ences to take precedence over many people living good lives, a "repugnant conclusion" (Parfit, 1984). 
Third, it also allows one individual (a "utility monster") with extremely high-quality experience to take 
precedence over many people living good lives (Nozick, 1974). I addressed these issues in my under- 
graduate thesis (Greene, 1997), and Felipe De Brigard (2010) makes a nice, empirically based argument 
along similar lines concerning the issue of artificial versus real experience. I won't say much about these 
issues here, because they are, in my estimation, less closely related to real-world moral issues, as they in- 
voke premises that take us deep into the realm of science fiction, pushing the imagination past its emo- 
tional, if not conceptual, limits. For further discussion of the utility monster and the repugnant 
conclusion see note "the 'in principle' version of this objection." 

an abstract idea... specific problems: For a general discussion of the tension between abstract and 
concrete thinking, see Sinnott-Armstrong (2008). 

hypothetical questions . .. widely underappreciated: For an excellent discussion of the allergy to hy- 
pothetical questions, see Kinsley (2003). 

utilitarianism defended: Two recent popular books—The Moral Landscape, by Sam Harris (2010), and 
The Righteous Mind, by Jonathan Haidt (201 2)— discuss recent advances in moral psycholog y/neurosci- 
ence and end up favoring a version of utilitarianism, as do in this book. Haidt does not attempt to de- 
fend utilitarianism against the objections listed above. Harris explains why utilitarianism's foundational 
principles are reasonable, as I do here in part 3, and as Bentham and Mill did long ago. Harris, however, 
pays little attention to the many compelling objections to utilitarianism listed above. Harris aims to show 
that science can "determine human values," but I don't think he does this, at least not in the sense that 
has been controversial among moral philosophers. He shows that, given an assumption of utilitarian 
values (which is neither supported nor undermined by science), science can determine further values. In 
other words, science can help us figure out what makes people happy. I’m sympathetic to Harris's practi- 
cal conclusions, but in my opinion he has ignored, rather than solved, the problem he seems to want to 
address. Many have offered similar assessments of his book, and he has responded. See Harris (January 
29, 2011). In part 4, I attempt to give utilitarianism a more thorough (though inevitably incomplete) 
defense, drawing on the new science of moral cognition. 
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accommodation and reform: My use of these terms comes from Brink (2011). See also Bazerman and 
Greene (2010) on utilitarian accommodation. 

greater good... in the long run: This still leaves us with the problem of endorsing such actions in 
principle, a problem that Í take seriously. More on this later. 

apparent intellectual inferioritv of women: Mill (1895). 

too inflexible to serve as the ultimate arbiters: These arguments resemble and build on ones made 
previously by Jonathan Baron (1994), Cass Sunstein (2005), Peter Singer (2005), Walter Sinnott- 
Armstrong (2004), and Stephen Stich (2006), among others. See also Greene (1997, 2002, 2007, under 
review). 

race of the defendant: Baldus, Woodworth, et al. (1998); Eberhardt, Davies, et al. (2006). See also US 
General Accounting Office (1990). 

controlled for people's real-world expectations: In these studies (Greene, Cushman, et al., 2009) we 
asked people versions of these three questions: In the real world, what are the odds that this attempt to save 
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five lives would go as planned? What are the odds that it would go worse than planned? What are the odds 
that it would go better? We then used people's answers to these questions to statistically control for people's 
real-world expectations. In other words, we asked whether we can predict people's judgments simply by 
knowing their real-world expectations. What we found was that we could a little bit, but not very much. It 
seems that when people say no to trading one life for five in these cases, it's not because of their real-world 
expectations. It's primarily because of the features of the dilemmas described below. 

“personalness” of the harmful action: Greene, Cushman, et al. (2009). The meaning of “personal” that 
comes out of these more recent studies is different from the one tentatively proposed earlier (Greene, Som- 
merville, et al., 2001). 

what seems to matter is touching: See also Cushman, Young, et al. (2006); Moore, Clark, et al. (2008); and 
Royzman and Baron (2002). 

without touching: Of course, there's a sense in which this involves touching, namely touching with a pole. 
a big drop: Greene, Cushman, et al. (2009). 

accommodation: That is, utilitarianism can accommodate the fact—I assume it's a fact—that a willingness 
to engage in personally harmful utilitarian actions likely indicates a more general antisocial willingness to 
harm people. See Bartels and Pizarro (2011) on Machiavellian utilitarianism. Conway and Gawronski (2012), 
however, show that the Machiavellians are not really utilitarian but rather undeontological. 

forbidden by international law: McMahan (2009). 

American Medical Association: American Medical Association (1991) 

no to the footbridge case: Greene, Cushman, et al. (2009). 

loop case: Thomson (1985). 

no point in hitting the switch: If you're thinking that this buys the five workmen more time, we can bulge 
out the main track in the other direction. 

81 percent. . . approved: This result is consistent with Thomson's (1985) intuition, and with Waldmann 
and Dieterich (2007), but not with Hauser, Cushman, et al. (2007). See Greene, Cushman, et al. (2009) for 
an explanation. 

“Doctrine of Triple Effect": Kamm (2000). 

87 percent... approved: As of this writing, these data have not been published. This experiment was con- 
ducted concurrently with those reported in Greene, Cushman, et al. (2009), using identical methods. Testing 
materials and data available by request. 

magic combination: If you've been paying really close attention, you'll have noticed a gap in this pattern. The 
collision alarm case gets 86 percent approval, and the remote footbridge case gets 63 percent approval. And yet, 
these are both means cases without personal force. Why the difference? It seems that there is another factor 
that interacts with the means/side-effect distinction: whether or not the victim gets dropped from a foot- 
bridge. If you do a dropping version of the collision alarm case, the approval ratings drop to roughly the level 
of remote footbridge. But if you do a dropping version of the switch case, the drop has little to no effect. More 
generally, it seems that multiple "forcey" factors (force of muscles, force of gravity) interact with the means/ 
side-effect factor. Even more generally, it seems that the effect of the means/side-effect factor does not depend 
entirely on the presence of personal force. But it does depend on the presence of some other factors, as demon- 
strated by the collision alarm and loop cases. 

bound up with... personal force: But not completely bound up. See previous note. 

no knowledge of the doctrine: Cushman, Young, et al. (2006); Hauser, Cushman, et al. (2007). 
intuitions that justify the principle: Cushman and Greene (2011). 

when we contemplate harming: This idea is similar to Blair's earlier idea of a violence inhibition mechanism 
(Blair, 1995). Cushman (in press) has a model according to which the emotional response to intentional 
personal harm is triggered not by a dedicated alarm system but by a learned negative emotional response en- 
coded within a more general emotional learning system (more specifically, a “model free" learning system). 
Cushman's model preserves the critical features of what Im here calling the myopic module. First, the emo- 
tional response is blind to side effects (myopia) and, for the reasons given here, related to the analysis of action 
plans. Second, this system's internal operations are not accessible to introspection. That is, they are “informa- 
tionally encapsulated" (modularity). But if Cushman is right—and I suspect that he is—this system is not 
specifically dedicated to serving the function that it serves here. That said, one can think of this learned associa- 
tion as a kind of acquired module. 

as Hobbes observed: Hobbes (1651/1994). 

smash his head in with a rock: It's not clear whether other species, such as chimps, can engage in this kind of 
premeditated violence. Chimps go on raiding parties, killing members of neighboring groups, but whether these 
killings are performed with a conscious goal in mind is unclear. They may be more like animal migrations— 
functional, complicated, and socially coordinated but not consciously carried out with a purpose. 

dangerous for... the attacker: DeScioli and Kurzban (2009). 
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how you treat others: Dreber, Rand, et al. (2008). 

contemplating an act of violence: Blair (1995). 

at least somewhat “modular”: Fodor (1983). 

Mikhail... Goldman... Bratman: Mikhail (2000, 2011); Goldman (1970); and Bratman (1987). 
approving more of... harmful side effects: Schaich Borg, Hynes, et al. (2006); Cushman, Young, et al. 
(2006). 

sounds the alarm: That is, the detween-dilemma variability is determined by the strength of the automatic 
responses. But in fact, the evidence suggests that much of the within-dilemma variability is determined by 
individual differences in reliance on manual mode. See Paxton, Ungar, and Greene (2011) and Bartels (2008). 
adding some pushing to the loop case: At the same time, adding a push to loop does appear to have some 
effect, which complicates things for the modular myopia hypothesis. Adding a push to switch has little or no 
effect, and, ideally, the same would be true for adding a push to loop. We do see an effectfullv consistent with 
the modular myopia hypothesis when it comes to adding drops (dropping onto the tracks from a footbridge 
through a trapdoor). That is, adding a drop to switch has little or no effect, and adding a drop to loop has little 
or no effect, but adding a drop to collision alarm significantly lowers approval ratings. This is all a work in 
progress, and it is not entirely clear to me what is going on. The critical point, for now, is that personal force 
and dropping do not seem to supply a fully adequate account of the gap between footbridge and loop. For now, 
Pm putting these unresolved ambiguities aside, because my purpose in this section is to lay out the modular 
myopia hypothesis as a hypothesis and not as a theory that currently explains everything. 

why ... chain with the harm ... secondary one?: The secondary causal chain is secondary because it is para- 
sitic on the primary causal chain. The turning of the trolley away from the five makes sense as a goal-directed 
action all by itself, without reference to the secondary causal chain, that is, to what happens after the trolley is 
turned. But the secondary causal chain cannot stand alone. Thisis because the secondary causal chain, to make 
sense as a complete action, must extend all the way back to the body movement, which is the hitting of the 
switch. But the hitting of the switch makes sense only with reference to the primary causal chain, that is, to the 
fact that the unturned trolley will proceed down the main track and kill the five if nothing is done. 

a means thatis structured like a side effect: Kamm (2000) refers to this kind of structure as a case of “triple 
effect,” one in which there is a foreseen event that is recognized as causally necessary for the achievement of 
the goal and yet is, in some morally relevant sense, not intended. 

cost-benefit . . . sufficiently compelling: Nichols and Mallon (2006); Paxton, Ungar, and Greene (2011). 
nested multitasking: Koechlin, Ody, et al. (2003). 

"Doctrine of Doing and Allowing": Howard-Snyder (May 14, 2002). 

choose between pairs of objects: Feiman et al. (in prep.). 

infants’ brains represented . . . experimenter wanted: This effect was first demonstrated by Woodward 
and Somerville (2000). 

people evaluated both active and passive harmful actions: Cushman, Murray, et al. (2011). 
ignoring...requires more manual-mode DLPFC activity: An earlier study provided more ambiguous evi- 
dence. Cushman, Young, et al. (2006) had people evaluate harmful actions and harmful omissions and then 
justify their ratings. About 80 percent of the time, people who distinguished between actions and omissions in 
their ratings were able to justify their judgments with an explicit appeal to the action/omission distinction. 
However, this means that about 20 percent of these people did what they did without knowing what they were 
doing. Clearly, these people were not consciously applying the action/omission principle in manual mode. It's 
not clear whether some or all of the 80 percent were doing so, or if they became conscious of the action/omission 
principle only after drawing the distinction intuitively. The brain-imaging data suggest the latter. 

tongue, fingers, and feet: Hauk, Johnsrude, et al. (2004). 

jacking up the price . . . feels less bad if done indirectly: Paheria, Kasam, et al. (2009). 

specifically intended: There is a technical problem with calling any of these harms "specifically intended." 
For example, in the footbridge case, one might say that what is specifically intended is using the man's body 
to block the trolley, which does not /ogically entail any harm to the man. (What if it's Superman?) By this 
interpretation, the death of che man and the pain he experiences are just contingent side effects, unfortunate 
by-products of using the man's body to stop the trolley. While this interpretation is possible in principle, this 
is clearly not how our brains represent these events. Thus, there is an interesting psychological problem here: 
namely, to understand the mechanism that parses events in these contexts. 

explanation of our sensitivity to the action/omission distinction: Cushman, Young, et al. (2006) have 
found effects of means versus side effect for passive harms, but these are likely cases in which the omission is 
unusually purposeful, very specifically failing to do what one would ordinarily do in order to save more lives. 
Thus, it may be possible, but unusual, to have omissions as part of an action plan, as in a recipe (“Do not 
remove the fritters from the oven until they are golden brown"). Also, it's worth noting that the means/ 
side-effect effect is much weaker for the omission cases. 
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represent causes in terms of forces: Talmy (1988); Wolff (2007); Pinker (2007). 

hitting, slapping, punching: This doesn't mean that it cant learn to respond to other kinds of violence, 
such as gun violence. It's possible that guns are sufficiently familiar that we incorporate the explosive force 
of agun into the body schema, conceptualizing it as a force that we personally control. The same may also 
happen with gravity. These are interesting empirical questions. For a fascinating and, I predict, very im- 
portant theory of how we learn to recoil at certain kinds of harms, I recommend Cushman (“Action, 
Outcome"). 

hard... to think of actions that don't feel violent: The best candidate that I can think of is surgery, but 
surgery does feel violent. It's just that surgeons learn to get over that feeling (if they're not psychopathic), and 
we don't blame them for what they do, because we know that their actions are for the good of the patient. 
millions of people can be saved by pushing: Paxton, Ungar, and Greene (2011). See also Nichols and 
Mallon (2006). The 70 percent figure comes from unpublished data using the same methods as Greene, 
Cushman, et al. (2009). 

would all be more psychopathic: Bartels and Pizarro (2011); Glenn, Raine, et al. (2009); Koenigs, 
Kruepke, et al. (2012). 

inferences about moral character: Pizarro, D.A. and Tannenbaum, D. (2011). Bringing character back: 
How the motivation to evaluate character influences judgments of moral blame. In M. Mikulincer & 
Shaver, P. (Eds) The Social psychology of morality: Exploring the causes of good and evil. APA Press. 
abortion and the Doctrine of Double Effect: Foot (1967). 

If harming the environment felt like pushing: See also Gilbert (July 2, 2006). 
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a dollar spent in the right way: Givewell.org (n.d.); Sachs (2006); Singer (2009). 

more accountable than ever: www.givewell.org. 

“decency to admit that Pm a hypocrite”: Exchange described by Simon Keller. 

neighbors are already doing it: Cialdini (2003). 

moral problem as... originally posed: Singer (1972). I've made some minor modifications to Singer's 
thought experiment. 

hard to justify treating the... faraway starving child differently: Jamieson (1999). 

"trolleyology" of Peter Singer's problem: Manuscript in preparation, based on Musen (2010). Much of 
the work done in these experiments was based on thought experiments carried out by Peter Singer (1972) 
and Peter Unger (1996). 

heavily influenced by mere physical distance: Nagel and Waldmann (2012) claim that mere physical 
distance does not matter and that the relevant factor is informational directness. However, my experi- 
ments with Musen show effects of mere distance independent of informational directness. In any case, it 
would be hard to argue that informational directness per se is a normatively significant factor. Therefore, 
the main conclusions reached here would not change if Nagel and Waldmann's conclusions are correct. 
faraway starving children don't: Note that in Trolleyland, spatial distance didn't seem to matter much, 
whereas here it does. This is likely because we're dealing with a different automatic setting, one that re- 
sponds to preventable harm rather than actions that cause harm. It could also be because the distances in 
these two types of cases differ by at least two orders of magnitude. 

from cultural evolution: Pinker (2011); Henrich, Ensminger, et al. (2010). 

unidentified "statistical" people: Some aid organizations deliberately pair individual donors with indi- 
vidual recipients in order to make the experience more personal. 

economist Thomas Schelling: Schelling (1968). 

“Baby Jessica": Small and Loewenstein (2003); Variety (1989). 

"statistical death": Schelling (1968); Small and Loewenstein (2003). 

identifiable . . . “statistical,” victims: Ibid. 

one sick child... or eight: Kogut and Ritov (2005). 

numbers as small as two: Slovic (2007). Note: My recommendations mirror Slovic's specific suggestions 
about how we might change our approach to the world's needy. 

give us legitimate moral obligations and options: Smart and Williams (1973). 

lives defined by relationships... must take this... into account: See Sidgwick (1907), 434. 
counterproductive to pooh-pooh philanthropists: Note: See Sidgwick (1907), 221, 428, and 493. 

if only they knew: A. Marsh, personal communication, January 31, 2013. 

Wesley Autrey: Buckley (January 3, 2007). 

only human: Note: See Parfit (1984) on blameless wrongdoing, 32. 

utilitarian rationale for punishing people: Bentham (1830). 
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favored by many: Kant (1785/2002). 

a little extra justice before pushing off: Cited in Falk (1990), 137. 

Prisoners are frequently sexually abused: Mariner (2001); Gaes and Goldberg (2004). 

is barbaric, we say: You might object that this is not a fair comparison, because prison rape as it occurs now is 
a chancy affair, while state-sanctioned rape would be a sure thing. Fair enough. We can use a roulette wheel to 
introduce an element of chance into our official state raping policy. Now do you like it? 

our current criminal justice system, which is highly retributive: Tonry (2004). 

natural function of punishment is quasi-utilitarian: Í say “quasi-utilitarian,” however, because our sense of 
justice is not necessarily designed to make us happier. The Us who benefits from punishment does not neces- 
sarily include everyone, and our sense of justice does not necessarily weight everyone's well-being equally. Still, 
overall, the existence of punishment is a good thing, by utilitarian standards or any reasonable standard. 
obvious utilitarian answer: Carlsmith, Darley, et al. (2002). 

punishing based solely on how they feel: Baron and Ritov (1993); Carlsmith, Darley, et al. (2002); Kahne- 
man, Schkade, et al. (1998). 

Crimes with lower detection rates: Carlsmith, Darley, et al. (2002). 

people punished “determined” transgressors about twice as much: Small and Loewenstein (2005). 
presented... with... "deterministic" universe: Nichols and Knobe (2007). 

abstract judgment goes out the window: See also Sinnott-Armstrong (2008). 

maximizing happiness can lead to gross injustice: Rawls (1971), 158-161. 

one-to-one ratio isa conservative assumption: The more typical situation, historically, is that one slave- 
holder owns many slaves. This only makes it harder for slavery to maximize happiness. One could imagine, 
however, going in the opposite direction, with a "time share" arrangement in which, say, five people own a 
slave collectively. But this doesn't change the fundamental math described below. This would mean, let's say, 
that each slave-share owner gets the equivalent of $10,000 additional income per year. Would you be willing 
to spend a fifth of your life as a slave in order to get a $10,000 raise? 

additional income . . . adds relatively little to one's happiness: Easterlin (1974); Layard (2006); Stevenson 
and Wolfers (2008); Easterlin, McVey, et al. (2010). As noted earlier (see chapter 6, "making a bit less 
money"), the debate is about whether additional income for those already well-off adds nothing, or relatively 
little, to one's happiness. 

not a tentative finding: Rawls (1971, 158-161) suggests that it is. But he was writing before research on 
happiness took off. 

"utility monsters": Nozick (1974). 

no goods to be extracted . . . outweigh the horrors: Still not convinced? Let's try a bit harder to think of 
realistic examples of utility-maximizing oppression. What about the old transplant case (Thomson, 1985)? 
W hat if a single healthy body could provide lifesaving organs to twenty people? Would a utilitarian allow us 
to randomly kidnap people and kill them for their organs, assuming this maximizes happiness? No, because 
there are clearly better alternatives. Before resorting to kidnapping, which would cause widespread panic and 
grief, we could establish a legal market for organs. You may or may not think this is a good idea, but it's not 
grossly unjust, à la slavery. Reasonable people can disagree about whether there ought to be a well-regulated 
market for human organs. 

What about the kind of oppression in which oppressing one person can benefit thousands of people? 
What about the crowds who cheer as lions tear into the entrails of hapless gladiators? Or people who enjoy 
child pornography? If there are enough gleeful onlookers, can such suffering be justified? Only if you think 
it's a net gain when people take joy in the exploitation and suffering of others. We can imagine a hypothetical 
world in which taking joy from the suffering of innocent people has no detrimental effects, but that’s not the 
real world. 
easy to mistake utilitarianism for “wealthitarianism”: Greene and Baron (2001). 
counting dollars, rather than happiness: Rawls (1971, 158-161, 167-168) is aware of the argument that 
people exhibit diminishing marginal returns of utility from goods and that therefore utilitarian policies will 
tend to favor egalitarian outcomes. But he dismisses this argumentas providing insufficient moral assurance. 
In doing this, he makes two assumptions. First, even if utilitarianism is generally egalitarian, it will some- 
times favor social inequality. Second, sometimes the inequalities that utilitarianism favors will be morally 
repugnant, à la slavery. Rawls is right about the first assumption (see above), but he takes this first assumption 
as license to make the second assumption, which is highly doubtful, at least in the real world. Rawls thinks 
the second assumption is also reasonable, but that, I claim, is because he's making the same error as everyone 
else: confusing utility with wealth. 
pattern... predicted .. . based on reading Rawls: Rawls's error is committed most starkly when he argues 
(Rawls, 1999, 144) that people should be risk averse with respect to utility, implying that some utility is worth 
more (i.e., has more utility) than other utilities. 
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the “in principle” version of this objection: Suppose that it really were possible to maximize happiness by 
oppressing some people. Wouldn't that still be wrong? And doesn't that show that there's something rotten at 
the core of utilitarianism? Here the classic example is Nozick's (1974) utility monster, which I alluded to 
above. Nozick's utility monster gains enormous quantities of happiness by eating people. But it seems that it 
would be wrong to feed innocent people to the utility monster, even if doing so would, by hypothesis, maxi- 
mize happiness. Another famous case comes from Derek Parfit (1984), who imagines a choice between two 
types of worlds: one in which very many people are very happy and one in which many, many more people 
lead lives that are “barely worth living." The "repugnant conclusion" that follows from utilitarianism is this: 
No matter how good the world is, there is always a better world, consisting of many, many more individuals 
whose lives are only minimally good. To drive the point home further, one can even substitute animals for 
people, so long as we agree that animal experience counts for something. One can imagine an immense 
warehouse full of trillions of rabbits whose brains are hooked up to stimulators that intermittently produce 
mild levels of rabbit gratification. What each rabbit gets is not that great, but there are so many rabbits. Thus, 
utilitarian revolutionaries could, in principle, justify destroying our world in order to realize their dream of 
building an enormous rabbit gratification factory. This prospect strikes most people as unjust. (Of course, no 
one has bothered to ask the rabbits!) 

I have two responses to these “in principle" objections. First, once again, I’m not claiming that utilitari- 
anism is the moral truth. Nor do I claim that it perfectly captures and balances all of human values. My claim 
is simply that it provides a good common currency for resolving real-world moral disagreements. If the utility 
monsters and the rabbits ever arrive, demanding their utilitarian due, we may have to amend our principles. 
Or maybe they would have a good point, albeit one that we have a hard time appreciating. 

Which brings me to my second response to these "in principle" objections. We should be very wary of 

trusting our intuitions about things that defy intuitive comprehension. The utility monster and the rabbits 
both push our intuitive thinking beyond its limits. More specifically, they push along orthogonal dimensions: 
quality and quantity. The utility monster is a single individual (low quantity) with an incomprehensibly high 
quality of life. He gets more out of a single meal than you get out of your entire existence. The rabbits, by con- 
trast, have a rather low quality of life, but the quantity of rabbits defies intuitive comprehension. Of course, 
there is a sense in which we can understand these things. After all, I just described them to you, and you un- 
derstood my description. But it's your manual mode that is doing the understanding. You cannot understand 
intuitively what it's like to eat a meal that produces more happiness than an entire happy human lifetime. 
Likewise, you can't intuitivelj distinguish between a million rabbits and a trillion rabbits. We can think about 
these things in an abstract way, but asking us to have gut feelings about such things is like asking a bird to 
imagine a worm that's a mile long. 
Rawls's argument from the "original position": If you know your Rawls, you'll have noticed that I didn't 
actually address his official argument against utilitarianism. Rawls argues that the most just organizing prin- 
ciples for a society are those that people would choose from behind a "veil of ignorance," not knowing which 
positions in society they will occupy. And he argues that people in this "original position" would not choose 
a utilitarian society, because the possible downside of living in a utilitarian society is too great. In other words, 
Rawls's official argument depends on the same mistaken assumption described above, which is that a utilitar- 
ian society could be oppressive in the real world, with human nature as it actually exists. Rawls's argument 
also involves some serious fudging related to risk aversion and the structure of the original position. For more 
on this, see chapter 11, "central argument in A Theory of Justice... ." 
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Ten percent... control 70 percent: Davies, Shorrocks, et al. (2007). See also Norton and Ariely (2011). 
Alex Kozinski: Alex Kozinski and Sean Gallagher, “For an Honest Death Penalty.” New York Times, March 
8, 1995. 

second moral compass: Thanks to Scott Moyers for suggesting the “two compasses” metaphor. 

how the brain gets out of this pickle: Botvinick, Braver, et al. (2001). This theory is somewhat controver- 
sial, but that need not concern us here. Our interest is in the cognitive strategy, regardless of whether the brain 
actually uses it. That said, I know of no alternative solution to the regress problem described above. 

engage the ACC and DLPFC: Greene, Nystrom, et al. (2004); Greene and Paxton (2009); Cushman, 
Murray, et al. (2011). 

wiser when we acknowledge our ignorance: Plato (1987). 

“illusion of explanatory depth”: Rozenblit and Keil (2002); Keil (2003). 

applied thisidea to politics: Fernbach, Rogers, et al. (in press). 
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left their strong opinions intact: The demand for reasons did moderate some people's views, but these 
tended to be people who couldn't produce any reasons at all when asked. 

may even do the opposite: Tesser, Martin, et al. (1995). 

an alternative approach to public debate: Sloman and Fernbach (2012); Fernbach (May 27, 2012). 

men crossing two different bridges: Dutton and Aron (1974). 

make up a plausible-sounding story and go with it: Fora classic demonstration of this kind of interpretive 
effect, see Schachter and Singer (1962). 

not an isolated phenomenon: Bargh and Williams (2006); Wilson (2002). 

choose... panty hose: Nisbett and Wilson (1977). 

"change into my work clothes": Stuss, Alexander, et al. (1978). 

"split-brain" patients: Gazzaniga and Le Doux (1978). 

plausible narrative: Bem (1967); Wilson (2002). 

consummate moral rationalizers: Haidt (2001, 2012). 

“Concerning Wanton Self-Abuse”: Kant's "Concerning Wanton Self-Abuse” is a section in the Metaphysics 
of Morals originally published in 1797. See Kant (1994). 

using someone as a means: Ibid. 

“Kant's joke”: Nietzsche (1882/1974). 

“born slaves": Bernasconi (2002). 

Rationalization . . . enemy of moral progress, and thus of deep pragmatism: The argument made in this 
section, along with other parts of this chapter, was originally made in Greene (2007). 

"outweighed" by the rights of the five: Thomson (1985, 1990). Note that Thomson has changed her mind 
and now thinks that it's wrong to turn the trolley (Thomson, 2008). What this essentially does is put the 
rights theorist’s explanatory burden on the act/omission distinction— that is, unless one thinks that we're 
obliged to actively turn the trolley away from the one and onto the five. 

wehave no duty to save them: Jamieson (1999). 

The rights and the duties follow the emotions: Kahane and colleagues (2010, 2012) have argued that there 
is no special relationship between automatic emotional responses and characteristically deontological moral 
judgments, and that the appearance of such a relationship is the product of a biased selection of stimuli. For 
evidence to the contrary, see chapter 6, "connection between manual-mode thinking," on the "white lie" case, 
and Paxton, Bruni, and Greene (under revision). 

sexiness is in the mind of the beholder: This doesn't mean that perceptions of sexiness are arbitrary. As 
evolutionary psychologists have pointed out (Miller and Todd, 1998), what we find sexually attractive is typi- 
cally indicative of high reproductive potential. But the fact that sexual attraction is non-arbitrary and biologi- 
cally functional does not imply that it's objectively correct. There's no meaningful sense in which we're 
objectively (absolutely, nonrelatively) correct about who's sexy while baboons are objectively incorrect— or 
vice versa. 

cognitive apparatus . . . concrete objects and events: Lakoff and Johnson (1980). 

nonnegotiable facts: Of course, there are facts about which rights and duties are granted by law, but in the 
midst of a moral controversy, such legal facts almost never settle the question. Public moral controversies are 
about what the law ought to be, not about what it is. 

not arguments, but weapons: [n a provocative paper, Mercier and Sperber (2011) claim that reasoning is just 
one big weapon for persuading others to do what we want. This strikes me as highly implausible. What makes 
their argument go is that they exclude from the category of "reasoning" all of the boring, everyday things for 
which we use our manual modes, such as figuring out the best order in which to run one’s errands. (“I'd better 
go food shopping last or else the ice cream will melt in the car”) This argumentative theory of reasoning also 
makes little evolutionary sense. Reasoning did not emerge de novo in humans. Indeed, the neural structures 
that we use for reasoning are the same ones that our primate relatives use to solve their own (fairly) complex 
problems. However, chimps and macaques very clearly do not engage in persuasive verbal jousting. 
Dershowitz once told a handful: This was told to me and other undergraduates at a “meet the professor" 
lunch in 1994. The details are as close as I can recall. 

costs of lavishing time and attention: To spell out this point more explicitly: Dershowitz's response was 
clever because it distinguished the benefits from the costs. He essentially said: I’m not refusing to debate you 
because I'm afraid. I'm refusing to debate you because there are costs associated with taking cranks like you 
seriously. But if you're willing to debate me in a way that denies you the credibility that you seek (the cost), 
then I'm happy to have a free exchange of ideas (the benefit). 

good .. . to reject some ideas out of hand: See also Dennett (1995) on “good nonsense.” 

truly moral considerations on both sides: Here, by "truly moral" I mean not just tribalistically moral. 
those of Peter Singer: Singer (1979), chap. 6; Singer (1994). 
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manual-modescrutiny: For arguments along the lines of those made here, see Singer (1979), chap. 6; Singer 
(1994). 

late-term abortions are not: If you're okay with late-term abortion, what about infanticide? Most of the ar- 
guments below apply equally well. 

Both early- and late-term abortions prevent a human life: The odds of living may differ, but surely this 
difference in the odds of successful birth (say, 60 percent vs. 95 percent) can't be the difference between hav- 
ing a right to life or not. And what if a late-term fetus, for some reason, had the same odds as a typical early- 
term fetus? Now would it be okay to abort it? 

Viability is as much a function of technology: You might say that what matters is the ability to survive 
without special technology. If that's right, then what about a nine-month-old fetus that, due to an atypical 
medical condition, can survive outside the womb, but only with the temporary help of readily available tech- 
nology? Is it okay to abort that late-term fetus simply because it's not viable without technology? 

born as early as twenty-two weeks can survive: Stoll, Hansen, et al. (2010). 

thanks to new technology . . . first-trimester abortions have become immorali: Perhaps you're inclined 
to say yes. After all, you might think that the possibility of being kept alive from that stage of development is 
morally significant. But note that it's not that technology enables the fetus to survive from that stage of de- 
velopment. Rather, technology enables the fetus to survive from that stage outside tbe womb. The fetus is al- 
ready able to survive from that stage of development without the fancy technology. It just has to stay inside 
the womb! We already have the "technology" to keep early-term fetuses alive. 

more than beinga moral vegetarian: At least it requires giving up certain kinds of meat. One could perhaps 
make room for certain other kinds of meat, such as that coming from animals that lack the relevant features. 
pro-choicers are unwilling to go that far: And even then, it's not clear that the argument works. Animal 
rights activists typically focus on the suffering that animals experience while being raised for food. If that's the 
reason why it's wrong to eat meat, then the same argument would not apply to late-term abortion, as long as 
the abortion process did not involve suffering, or did not involve a lot of suffering. 

Deanna Troi. .. not human: Okay, okay: not fully human. She's only half Betazoid. But the point applies 
to her maternal relatives. /eez. 

can move their bodies: Dongen and Goudie (1980). 

which human shall be, if anyone is to be: Of course, with only one sperm on deck, the odds of fertilization 
are lower, but so what? Pro-lifers would not allow us to abort a zygote simply because it has, for whatever 
reason, low odds of surviving. 

robbed an innocent person of his life?: Moreover, the idea that conception determines identity seems to 
have more to do with our limited knowledge than with facts about what has or has not been determined. 
When a couple sets out to conceive a child the old-fashioned way, they may not know which sperm and egg 
are going to join, and we may have no way of knowing. But whichever child is going to result from a given act 
of sexual intercourse, #bat the child that's going to result. And if the couple decides not to go through with 
it, it's that child who will not exist asa result of their backing out. When this happens, no one knows, or will 
ever know, who "that child" is, but so what? If their having sex would have led to some specific child's exist- 
ing, then their refraining from having sex led to the nonexistence of that specific child. (I'll refrain from 
getting into the problem of determinism at this point.) 

full biology lesson: Gilbert (2010), 6, 14, 123—158, 301. 

“I think even if life begins in that horrible situation of rape": Madison (2012). 

campaign went up in flames: Haberkorn (2012). 

“problem of evil": Tooley (2008). 

silent drama: Heider and Simmel (1944). 

attributions happen so automatically: Heberlein and Adolphs (2004). 

animals... move and have eyes: Many of us would have a hard time killing the animals we eat, but that's 
probably just because we're not used to it. Our ancestors did this for millions of years. 

Most tribes believe in souls: Bloom (2004). 

what's right and wrong when it comes to life and death: Beauchamp, Walters, et al. (1989); Baron (2006); 
Kuhse and Singer (2006). 

less optimistic. . . about . . . sophisticated moral theory: See also Greene (under review). 

"reflective equilibrium": Daniels (2008). 

"considered judgments": Gut reactions are not the same as "considered judgments," but they play a domi- 
nant role in determining them. 

Aristotle... great champion of common sense: A ristotle (1941). 

Aristotle is essentially a tribal philosopher: MacIntyre (1981). 

Aristotelian virtue theory... revival: As part of the Aristotelian revival, I include not just virtue eth- 
ics proper (Crisp and Slote, 1997; Hursthouse, 2000), but also "sensibility" theories (Wiggins, 1987), 
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particularism (Dancy, 2001), and the like—all of the approaches to normative ethics that have given up on 
discovering or constructing explicit moral principles that tell us what to do. The revival is due in large part to 
Alasdair MacInytre (1981), who has a similar diagnosis of modern moral problems but thinks that a re- 
vamped form of virtue theory is the best we can do, following on the failures of Enlightenment moral 
theory. 

cannot be “universalized”: Kant (1785/2002). 

Kant's argument requires impossibility: Kant's universalization argument is not simply a version of the 
familiar "What if everyone did that?” argument. He's not merely saying that it would be bad if everyone were 
to lie, break promises, et cetera. That'sa utilitarian argument against lying—rule-utilitarian or act-utilitarian, 
depending on how you interpret it. This isn't good enough for Kant, because he wants an absolute prohibition 
against lying, one that doesn't depend on how things happen to work out in the real world. (Things tend to 
go badly if everyone lies, et cetera.) He wants morality to be like math: necessarily true and knowable with 
certainty. See Korsgaard (1996), chapter 3. 

well aware of the flaws . . . they have their replies: See, for example, Korsgaard (1996). 

central argument in A Theory of Justice .. . essentially a rationalization: While there is much to admire 
about Rawls's work, and the man himself, I believe that his central argument is essentially a rationalization, 
an attempt to derive from first principles the kind of practical moral conclusions that he intuitively favors, 
which he mistakenly believes to be at odds with utilitarianism. (See pp. 279-84.) Rawls's main argument is 
laid out in chapters 1, 2, and 3 of A Theory of Justice (1971). 

I mentioned earlier that utilitarianism begins with two very general moral ideas. First, happiness is 
what ultimately matters and is worth maximizing. Second, morality must be impartial. Essentially, Rawls 
keeps the impartiality assumption but drops the assumption that happiness is what ultimately matters. He 
replaces the assumption that happiness is inherently valuable with the assumption that choice is inherently 
valuable. Thus, for Rawls, the best organizing principles for a society are the ones that people would choose 
if they were to choose impartially. This is a great idea, with roots in the philosophies of both Kant and John 
Locke. (Rawls, like Locke, is a "contractarian.") 

So how do we figure out what people would choose if they were to choose impartially? To answer this 
question, Rawls constructs a thought experiment. He imagines a situation, called the original position, in 
which it's impossible to choose in a directly self-serving way and then asks what people would choose. Choos- 
ing in a straightforwardly selfish manner is impossible in the original position, because one chooses from 
behind a veil of ignorance. That is, the parties in the original position must negotiate an agreement about 
how their society will be organized without knowing their own races, genders, ethnic backgrounds, social 
positions, economic statuses, or the nature and extent of their natural talents. The idea, then, is that the ne- 
gotiators have been denied all of the information they could use to bias the agreement in their respective 
favors. The decision makers are expected to choose rationally and selfishly, but because they are choosing 
from behind a veil of ignorance, the kind of social structure they choose is, according to Rawls, necessarily 
fair and just. Agreeing on a social structure from behind a veil of ignorance is rather like using the "I cut, you 
choose" method for dividing a piece of cake. The fairness emanates from the decision procedure rather than 
from the goodwill of the decision makers. 

This core idea (modeling social choice as bias-free selfish choice) was developed independently, and 
slightly earlier, by the Hungarian economist John Harsanyi (1953, 1955), who would later win the Nobel Prize 
in economics for his contributions to game theory. Harsanyi, unlike Rawls, saw his version of the original posi- 
tion as providing a rational grounding for utilitarianism. Harsanyi imagined people choosing their society's 
organizing principles while not knowing which positions in society they would occupy (rich or poor, etc.) but 
knowing that they would have an equal probability of occupying any position in society. Given this assumption, 
if people are utility maximizers (each seeking to maximize his/her own happiness), the decision makers will 
choose a society organized so as to maximize utility, one that is as happy as possible overall. (This maximizes 
both the total and the average amount of happiness, assuming that the population size is fixed.) 

Rawls, however, argued for a very different conclusion about the kind of society that selfish people in 
the original position would choose. Rawls says that the original positioners would choose a society organized 
by a “maximin” principle rather than a utilitarian principle. The maximin principle ranks societies based 
solely on the status of the society's least well-off person. According to this principle, one's preferences for one 
societal arrangement over another will be based entirely on the "worst-case scenario" within each arrange- 
ment. Rawls acknowledges that this is not, in general, a good decision rule, as illustrated by the following 
example. 

Suppose that you are buying a car, but in the following unusual way. You must buy a lottery ticket that 
will give you one car randomly chosen from a lot of a thousand cars. Ticket A takes you to a lot that has a 
thousand mediocre cars. On a scale of 1 to 10, each of these cars is a 4. If you buy ticket A, you get one of 
those. Ticket B takes you to a lot that also has a thousand cars. This lot has 999 cars that score a perfect 10 


on your scale; however, it also has one car that scores a 3. So if you buy ticket B, you have a 99.9 percent 
chance of getting your dream car, but you have a 0.1 percent chance of getting a car that's okay but slightly 
worse than the one you're guaranteed to get with ticket A. Which do you choose? Obviously, you would 
choose ticket B. However, according to the “maximin” rule, you would choose ticket A, because the worst- 
case scenario in buying ticket À is better than the worst-case scenario in buying ticket B. Not so smart. 

The problem with the maximin rule is that it's maximally risk averse. Rawls agrees that such risk aver- 
sion is not appropriate in general (e.g., when buying cars by lottery), but he argues that it is appropriate for 
people who are choosing their societv's organizing principles without knowing which positions in societv 
they will occupy. Rawls thinks that life in a utilitarian society might be “intolerable” (pp. 156, 175). If you're 
randomly plopped into a utilitarian society, Rawls warns, you could end up as a slave. Such outcomes are so 
bad that no one would choose to take that risk. Instead, people choosing from behind the veil of ignorance 
would use the maximin rule, favoring the society with the best worst-case scenario. Rawls makes this argu- 
ment with respect to what he calls “basic liberties.” Rather than leave the allocation of liberties up to utilitar- 
ian calculations, the people in the original position would choose principles that directly secured “basic 
liberties." He makes the same kind of argument about educational/economic opportunities and about eco- 
nomic outcomes. Here, too, says Rawls, the worst-case scenario in a utilitarian society could be so bad that 
it's not worth taking the risk. 

First, let's note that Rawls's formal argument depends on the error described in the last chapter, confus- 
ing wealth and utility. More specifically, Rawls assumes that the people in the original position would make 
the same mistake that he makes. Once again, the reason for favoring the maximin rule is that the worst-case 
scenario in a utilitarian society might be “intolerable.” It's not hard to see how the worst-case scenario in a 
wealthitarian society would be intolerable. Maximizing GDP might require some oppression, but, as explained 
earlier, it's simply not plausible that making the world as happy as possible could, in the real world, require 
oppression. Human psycholog y would have to be completely rewired such that the suffering caused by being a 
slave is smaller than the benefits one derives from owning a slave, and so on. (Once again, would you give up 
half your life to slavery in order to have a slave for the other half? Could you imagine a situation in the real 
world in which this is a tough decision?) 

That's Rawls's first mistake. (I don't think this is a rationalization. I think it's just a mistake.) But now 
let's suppose that Rawls is right and that life in a maximally happy society could be, for some, “intolerable.” 
Even if you make this implausible assumption, Rawls's argument still doesn't work. Once again, Rawls's 
maximin rule evaluates each societal arrangement based solely on its worst-case scenario—the quality of life 
of that society's least well-off person. In other words, Rawls assumes that people will be maximally risk averse 
so long as there are intolerable outcomes in the mix. But as Harsanyi (1953, 1955) and others have pointed 
out, that is simply not a reasonable assumption. Every time you get in a car, you increase your risk of being 
horribly maimed in a car accident, an outcome that most of us would regard as “intolerable” in Rawls's sense. 
And yet we accept such risks for things as trivial as a late-night pint of ice cream. (You might point out that 
one can be horribly maimed by staying home. For example, the roof could collapse. Thus, the worst-case 
ine, but then you have to 


scenario is actually the same whether you make your ice cream run or not. That's 
apply the same logic to Rawls's argument. Life could be “intolerable” even in a society governed by maximin. 
Your roof could collapse.) 

To prime the risk aversion pump, Rawls adds an unnecessary twist to his version of the original posi- 
tion. In Harsanyi's version, if you recall, the decision makers choose while knowing that they will have an 
equal probability of occupying each position in society. Rawls, however, does something different. He assumes 


that people in the original position have no information at all about the range of possible outcomes and their 


associated odds, leaving them in a state of complete actuarial ignorance. In this state of maximal ignorance, 
Rawls argues, the people in the original position would, and should, be highly risk averse. ("Anything could 
happen!”) In technical terms, Rawls makes the original position an ambiguous situation rather than merely an 
uncertain one. 

Why does Rawls make the decision in the original position maximally ambiguous? Why not simply 
assume, as Harsanyi does, that the people in the original position know the range of possible social positions 
and know that they have equal odds of landing in any one of them? Rawls addresses this issue, and as far as I 
can tell, his argument is completely circular. He defines the original position as one in which people have no 
information about the attendant probabilities, and then argues, on that assumption, that they should not rely 


ies are (pp. 155, 


on probability estimates, because, really, they have no way of knowing what the probab 
168—169). As Harsanyi (1975) points out, even under this assumption of complete ignorance, an assumption 
of equal probability for all outcomes would be far more rationally defensible than the assumption that the 
worst outcome has an effective probability of 100 percent— the assumption built into the maximin rule. But 
we can put that aside. Why, in the first place, should Rawls define the original position as one in which the 
outcome probabilities are unknown? The whole point of the original position is to constrain the choice so that 


the decision makers are effectively impartial. To be impartial is to give equal weight to each person's interests. 
Thus, it makes perfect sense to define the original position as one in which each chooser knows that she has 
an equal probability of occupving each position in society. This would in no way bias people's choices. On the 
contrary, it embodies the ideal of impartialitv in the clearest possible way. 

As far as I can tell, Rawls makes the probabilistic structure of the original position maximally ambigu- 
ous for reasons that have nothing to do with justice or fairness or impartiality. As far as I can tell, this is just 
a fudge, an ad hoc attempt to make his intuitivelv correct answer more plausible. Coming into the world of 
political philosophv, Rawls has no particular reason to adopt an extreme theorv of risk aversion. But once he's 
committed to the original position as a device for working out a theory of justice— which is a very nice idea— 
he suddenly finds himself in an awkward position. He wants a society in which priority is given, as a matter 
of first principles, to people with the worst outcomes. But this desire, filtered through the logic of his thought 
experiment, requires Rawls's hypothetical selfish decision makers to be inordinately preoccupied with the 
worst outcomes as they make their self-interested choices. That is, he needs them to be inordinately risk 
averse. And thus, to get his desired result, Rawls adds a layer of gratuitous ambiguity to his thought experi- 
ment to make extreme risk aversion seem more plausible. 

As in Kant's case, this kind of finagling makes it clear what Rawls is really up to. He's not starting with 
first principles and then following them to their logical conclusions. He knows where he wants the argument 
to go, and he's doing everything he can to get it there. 

Thus, Rawls's well-intentioned rationalizing illustrates two points. First, it's another nice example of 
what happens when very smart people are determined to vindicate their moral emotions through reasoning. 
Second, it suggests that Harsanyi may be right. If you run the original-position thought experiment properly 
by (a) not confusing wealth and utility, (b) not assuming that people are inordinately risk averse, and (c) not 
making the hypothetical decision gratuitously ambiguous, you just might end up with a utilitarian conclu- 
sion. In other words, if you replace the happiness assumption with an assumption favoring choice, you end up 
with utilitarianism, because impartial people, with no ideological commitments, will naturally choose a soci- 
ety that maximizes their prospects for happiness. 
wasn't always a liberal: In my youth I was something of a libertarian conservative. My libertarian claim to 
fame: In my senior year of high school I won third prize in an Ayn Rand essay contest. However, by the time 
the prize came through, I was already starting to change my mind. I shared my doubts with the woman who 
called to congratulate me. This did not go over well. 

Jonathan Haidt: Haidt (2001, 2007, 2012). 

“Emotional Dog": Haidt (2001). 

this characterization of his view: According to Haidt, moral reasoning plays an important role in his land- 
mark theory of moral psychology, the Social Intuitionist Model (SIM) (Haidt, 2001). Whether this is true 
depends on what counts as moral "reasoning" (Paxton and Greene, 2010). 

According to the SIM, moral judgment works as follows: Moral judgments are, in general, caused by 
moral intuitions, and when we engage in moral reasoning, our reasoning is typically deployed post hoc to 
justify the moral judgments that we have already made on an intuitive basis. (See discussion of moral ratio- 
nalization earlier in this chapter.) Haidt says that people do sometimes engage in private moral reasoning, but 
that this is “rare, occurring primarily in cases in which the intuition is weak and processing capacity is high” 
(p. 819). This is why I say that, according to Haidt, moral reasoning plays a minor role in moral life. 

However, there are two additional psychological processes to consider, the ones that put the "Social" 
in the SIM. First, according to the SIM, Person A's overtly making a moral judgment can influence Person 
B's moral intuitions, which can in turn influence Person B's moral judgment. Haidt calls this "social persua- 
sion." This is clearly not moral reasoning, as there is no argument, just an intuitive response to observing 
another's judgment or behavior. Second—and this is the key part—Haidt says that people engage in "rea- 
soned persuasion." Here, Person A provides a verbal justification for her judgment; Person B hears this justi- 
fication; and this modifies his moral intuitions, which in turn influences his moral judgment. Haidt calls this 
"reasoned persuasion," but that label, I think, is misleading. Here, Person A influences Person B's judgment 
by modifying Person B's feelings (automatic settings) and not by engaging Person B's capacity for explicit 
reasoning (manual mode). Here the "reasons" that Person A produces function like a song that succeeds in 
moving Person B. 

Haidt believes that this process is widespread and highly influential (which it may be). This is why he 
says that moral reasoning plays an important role in moral life. But, as I’ve said, I don't think that this quali- 
fies as "moral reasoning." And that is why I say, over Haidt's protests, that his view is not one according to 
which moral reasoning plays a major role. According to the SIM, I cannot change your mind on a moral issue 
(such as gay marriage, abortion, or eating animals) without first changing your feelings. I cannot appeal di- 
rectly to your capacity for reasoning and thus cause you to override your feelings. I think that this picture of 
moral psychology is incorrect. This point is illustrated. by an experiment in which my collaborators and I 
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used 3 rather abstract argument to persuade people (at least temporarily) to accept a counterintuitive moral 
conclusion (Paxton, Ungar, and Greene, 2011). 

Some liberals say . . . some social conservatives believe: Here are two examples: http://www.libchrist.com/ 
other/abortion/choice.html; http://k2globalcommunicationsllc.wordpress.com/2012/08/28/abortion-nihilist 
-argument-eliminate-poverty-kill-the-poor. See also John Paul II (1995). 

liberals have impoverished moral sensibilities: Haidt and Graham (2007); Graham, Haidt, et al. (2009); 
Haidt (2012). 

doubts about this six-part theory. . . important aspect... well-supported: The survey data (Graham et 
al., 2009, 2011) that Haidt uses to support his theorv (the original version with five foundations) show an 
enormous division between two clusters: the care-fairness cluster and the loyalty-authority-sanctity cluster. 
There is, by contrast, relatively little evidence for a two-wav division within the first cluster or a three-way 
division within the second cluster, and what evidence there is can be accounted for by the fact that the surveys 
used to collect these data were designed with five clusters in mind. To provide strong evidence for a five-factor 
(or six- or n-factor) theory of morality, one would have to use a “bottom-up” approach, testing the theory 
using testing materials that were not designed with any particular theory in mind. Haidt says that, to a first 
approximation, the moral world has five (or six) “continents.” In Haidt's data, Í see evidence for two conti- 
nents, which may or may not have two or three interesting bulges. 

questions like these: Graham, Haidt, et al. (2009) posed these questions in a different way (“How much 
money would it take for you to . . . ?"). 

Bentham and Kant: | think that Haidt's (2012) psychological portrait of Kant (p. 120) is off the mark. Kant 
might have had some autistic tendencies, and he was certainly a "systematizer," but he was very authoritarian 
and no stranger to moral disgust. He was also, not incidentally, very religious. 

WEIRD: See Henrich, Heine, et al. (2010). 

predicting what liberals will say ... vice versa: Graham, Nosek, et al. (2012). 

dismisses ... science: Mooney (2012). 

“real” Americans: Devos and Banaji (2005). 

45 percent of Republicans believe: Condon (April 21, 2011). 

little respect for... United Nations: Wike (September 21, 2009). 

Muslim American. .. should not be trusted: Arab American Institute (August 22, 2012). 

If Iranians .. . want to protest: Swami (June 15, 2009). 

minority .. . report believing in God: European Commission (2005). 

lowest crime rates... happiness: Economic Intelligence Unit (2005); United Nations Office of Drugs and 
Crime (2011); United Nations (2011); Ingelhart, Foa, et al. (2008). Murder rates, educational attainment, 
and test scores: World Values Survey on happiness. 

“yang”... “yin”: Haidt (2012), 294. 

no Republicans hold elected office: Based on my own online searches and confirmed by Henry Irving, 
Republican city committee chair, Cambridge, MA (personal communication, March 24, 2013). 

bonds are rated AAA: http: //www.cambridgema.gov/citynewsandpublications/news/2012/02/cambridge 
maintainsraredistinctionofearningthreetriplearatings.aspx. 

social conservatives are very good at: Putnam (2000); Putnam and Campbell (2010). 

“Spread my work ethic”: Haidt (2012), 137. 

Refusing to buy... more harm than good: Nicholas D. Kristof, “Where Sweatshops Are a Dream.” New 
York Times, January, 14, 2009. 

“welfare queens”: The term was coined by Ronald Reagan during his 1976 presidential campaign: “‘ Welfare 
Queen’ Becomes Issue in Reagan Campaign.” New York Times, February 15, 1976. 

former slave states: Lind (2012). 

government hands off my Medicare: Krugman (July 28, 2009). 

billionaires . . . lower rate than their secretaries: Tienabeso (January 25, 2012); Buffett (August 14, 2011). 
reliable returns: Yes, such donors might benefit enormously from a Romney administration’s policies, but 
the odds that any single donor’s donation would sway the election are extremely small. 

endorses . . . utilitarianism: Haidt (2012) endorses, for the purposes of making policy, what he calls “Dur- 
kheimian utilitarianism” (p. 272), which is utilitarianism that accounts for the value of conservative social 
institutions such as religion. Durkheimian utilitarianism is actually just utilitarianism wisely applied. Nev- 
ertheless, the point is worth making because not all self-styled utilitarians appreciate the value of conservative 
social institutions. Mill (1885), however, certainly did, as explained, for example, in his essay “The Utility of 
Religion.” 

€1 don’t know”: Haidt (2012), 272. 

“90 percent chimp and 10 percent bee”: Ibid., xv. 

moral reasoning. .. ineffective, though not completely: See Paxton, Ungar, and Greene (2011). 
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a good argument can change the shape of things: An alternative analogy: A good argument is like a piece 
of technology. Few of us will ever invent a new piece of technology, and on any given day its unlikely that 
we'll adopt one. Nevertheless, the world we inhabit is defined by technological change. Likewise, I believe 
that the world we inhabit is a product of good moral arguments. It's hard to catch someone in the midst of 
reasoned moral persuasion, and harder still to observe the genesis ofa good argument. But I believe that 
without our capacitv for moral reasoning, the world would be a verv different place. See also Pinker (2011), 
chaps. 9-10; Pizarro and Bloom (2003); Finnemore and Sikkink (1998). 

“I have been tormenting”: Bentham (1978). 

“But it would be a mistake”: Mill (1895), 1-2. 
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Chekhov: See introduction, “man will become.” 

consult, but do not trust, your moral instincts: This rule is available in bumper sticker form: “Don't believe 
everything you think.” Available at www.northernsun.com. 

manual mode... Me ahead of Us: Valdesolo and DeSteno (2007). 

more important than saving someone's life: Likewise, few of us can honestly say that animals should suffer 
enormous pain because pork is tastier than tofu or because an extra dollar is too much to spend on a cruelty- 
free cheeseburger (not widely available, but only for lack of demand). 


